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Preface 


Over the last few years, there has been a significant increase in the number of 
students studying partial differential equations at the undergraduate level, and 
many of these students have come from areas other than mathematics, where 
intuition rather than mathematical rigor is emphasized. In writing Partial Dif- 
ferential Equations for Scientists and Engineers, I have tried to stimulate intuitive 
thinking, while,, at the same time, not losing too much mathematical accuracy. 
At one extreme, it is possible to approach the subject on a high mathematical 
epsilon-delta level, which generally results in many undergraduate students not 
knowing what’s going on. At the other extreme, it is possible to wave away all 
the subtleties until neither the student nor the teacher knows what's going on. 
I have tried to steer the mathematical thinking somewhere between these two 
extremes. 

Partial Differential Equations for Scientists and Engineers evolved from a set 
of lecture notes I have been preparing for the last five years. It is an uncon- 
ventional text in one regard: It is organized in 47 semi-independent lessons in 
contrast to the more usual chapter-by-chapter approach. 

Separation of variables and integral transforms are the two most important 
analytic tools discussed. Several nonstandard topics, such as Monte Carlo meth- 
ods, calculus of variations, control. theory, potential theory, and integral equa- 
tions, are also discussed because most students will eventually come' across these 
subjects at some time in their studies. Unless they study, these topics here, they 
will probably never study them formally. 

This book can be used for a one- or two-semester course at the junior or 
senior level. It assumes only a knowledge of differential and integral calculus 
and ordinary differential equations. Most lessons take either one or two days, 
so that a typical one-semester syllabus would be: Lessons 1-13, 15-17, 19-20. 
22-23, 25-27, 30-32, 37-39. All 47 lessons can easily be covered in two semesters, 
with plenty of time to work problems. 

The author wishes to thank the editors at Wiley for their invitation to write 
this book as well as the reviewers, Professor Chris Rorres and Professor M. 
Kursheed Ali, who helped me greatly with their suggestions. Any further sug- 
gestions for improvement of this book, either from students or teachers, would 
be greatly appreciated. Thanks also to Dorothy, Susan, Alexander, and Daisy 
Farlow. 


Stanley J. Farit 





^,k 

v eAc 



Contents 


1 INTRODUCTION / 1 

LESSON 1 Introduction to Partial Differential Equations / 3 

2 DIFFUSION-TYPE PROBLEMS / 9 

LESSON 2 Diffusion-Type Problems (Parabolic Equations) / 11 
LESSON 3 Boundary Conditions for Diffusion-Type Problems / 19 
LESSON 4 Derivation of the Heat Equation / 27 
LESSON 5 Separation of Variables / 33 
LESSON 6 Transforming Nonhomogeneous BCs into Homogeneous 
Ones / 43 

LESSON 7 Solving More Complicated Problems by Separation of 
Variables / 49 

LESSON 8 Transforming Hard Equations into Easier Ones / 58 
LESSON 9 Solving Nonhomogeneous PDEs (Eigenfunction 

Expansions) / 64 , 

LESSON 10 Integral Transforms (Sine and Cosine Transforms) / 72 
LESSON 11 The Fourier Series and Transform / 81 
LESSON 12 The Fourier Transform and its Application to PDEs / 89 
LESSON , 13 The Laplace Transform /_ 97 
LESSON 14 Duhamel’s Principle / 106 
LESSON 15 The Convection Term «, in Diffusion Problems / 112 


3 HYPERBOLIC-TYPE PROBLEMS / 121 

LESSON 16 The One Dimensional Wave Equation (Hyperbolic 
Equations) / 123 

LESSON 17 The D’Alembert Solution of the Wave Equation • 129 
LESSON 18 More on the D’Alembert Solution 137 
LESSON 19 Boundary Conditions Associated with the Wave Equation 
146 

LESSON 20 The Finite Vibrating String (Standing Waves) 153 



LESSON 21 The Vibrating Beam (Fourth-Order PDE) / 161 
LESSON 22 Dimensionless Problems ’ 168 

LESSON 23 Classification of PDEs (Canonical Form of the Hyperbolic 
Equation) 174 

LESSON 24 The Wave Equation in Two and Three Dimensions (Free 
Space) / 183 

LESSON 25 The Finite Fourier Transforms (Sine and Cosine 
Transforms! 191 

LESSON 26 Superposition (The Backbone of Linear Systems) / 198 
LESSON 27 First-Order Equations (Method of Characteristics) / 205 
LESSON 28 Nonlinear First-Order Equations (Conservation 
Equations) '< 213 

LESSON 29 Systems of PDEs / 223 

LESSON 30 The Vibrating Drumhead (Wave Equation in Polar 
Coordinates) / 232 

4 ELLIPTIC-TYPE PROBLEMS / 243 

LESSON 31 The Laplacian (an intuitive description) / 245 
LESSON 32 General Nature of Boundary-Value Problems / 253 
LESSON 33 Interior Dirichlet Problem for a Circle / 262 
LESSON 34 The Dirichlet Problem in an Annulus / "270 
LESSON 35 Laplace’s Equation in Spherical Coordinates (Spherical 
Harmonics) / 280 

LESSON 36 A Nonhomoaeneous Dirichlet Problem (Green’s Functions) / 
290 


5 NUMERICAL AND APPROXIMATE METHODS / 299 

LESSON 37 Numerical Solutions (Elliptic Problems) / 301 
LESSON 38 An Explicit Finite-Difference Method / 309 
LESSON 39 An Implicit Finite-Difference Method (Crank-Nicolson 
Method) / 317 

LESSON 40 Analytic versus Numerical Solutions / 324 
LESSON 41 Classification of PDEs (Parabolic and Elliptic Equations) / 
331 

LESSON 42 Monte Carlo Methods (An Introduction) / 340 
LESSON 43 Monte Carlo Solutions of Partial Differential Equations / 
346 

LESSON 44 Calculus of Variations (Euler-Lagrange Equations) / 353 


LESSON 45 Variational Methods for Solving PDEs (Method of Riu) / 
362 

LESSON 46 Perturbation Method for Solving PDEs / 370 
LESSON 47 Conformal-Mapping Solution of PDEs / 379 


ANSWERS TO SELECTED PROBLEMS / 389 
APP. 1 INTEGRAL TRANSFORM TABLES / 399 
APP. 2 PDE CROSSWORD PUZZLE / 408 
APP. 3 LAPLACIAN IN DIFFERENT COORDINATE SYSTEMS 
/ 411 

APP. 4 TYPES OF PARTIAL DIFFERENTIAL EQUATIONS / 412 
INDEX / 413 


f 


viii Contents 


Contents IX 


Partial 

Differential 

Equations 

for 

Scientists and 
Engineers 



LESSON 1 

Introduction to Pamal Differential 
Equations 


PURPOSE OF LESSON: To show what partial differential equations 
are, why they are useful, and how they are solved; also included is a brief 
discussion on how they are classified as various kinds and types. An over- 
view is given of many of the ideas that will be studied in detail later. 


Most physical phenomena, whether in the domain of fluid dynamics, electricity , 
0 4 magnetism, mechanics, optics, or heat flow, can be described in general by 
partial differential equations (PDEs); in fact, most of mathematical physics are 
PDEs. It’s true that simplifications can be made that reduc^ the equations in 
question to ordinary differential equations, but, ne\fertmf1ess. the complete 
. description of these systems resits in the general area of PDEs. 


What Are PDEs? 

A partial differential equation is an equation that contains partial derivatives. 
In contrast to ordinary differential equations (ODEs), where the unknown func- 
tion depends only bn one variable, in PDEs, the unknown function depends on 
several variables (like temperature u(x,t) depends both on location x and 

time f): ' " ~ 

Let’s list some well-known PDEs; note that for notational simplicity we have 
called 


_ dU du d^U 

~ .dr l “ ~ dx v ‘ ~ dx 2 

A Few Well-Known PDEs 

u t — (heat equation in one dimension) 

u, = », A - (heat equation in two dimensions) 

u rr -- u m = () (Laplace’s equation in polar coordinates) 
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u„ = u x , -r u y} -f (wave equation in three dimensions) 

u„ = u„ + au, -r (Jm (telegraph equation) 

Note on the Examples 

The unknown function u always depends on more than one variable. The variable 
w (which we differentiate) is called the dependent variable, whereas the ones we 
differentiate With respect to are called the independent variables. For example, 
it is clear from the equation 


that the dependent variable u(x.t) is a function of two independent variables a 
and t, whereas in the equation 

.... ! j 

U, = U„ + -u, + — M ee 

u(r,6,t) depends on r, 6, and t. 


Why Are PDEs Useful? 

Most of the natural laws of physics, such as Maxwell's equations, Newton’s law ' 
of cooling, the Navier-Stokes equations, Newton’s equations of motion, and 
Schrodinger’s equation of quantum mechanics, are stated (or can be) in terms 
of PDEs. that is, these laws describe physical phenomena by relating space and 
time derivatives. Derivatives occur in these equations because the derivatives 
represent natural things (like velocity, acceleration, force, friction, flux, current). 
Hence, we have equations relating partial derivatives of some unknown quantity 
that we would like to find. . . 

The purpose of this book is to show the reader two things 

1. How to formulate the PDE from the physical problem (constructing the 
mathematical model). 

2. How to solve the PDE (along with initial and boundary conditions). 

We wait a few lessons before we start the modeling problem; now, a brief 
overview on how PDEs are solved. 


How Do You Solve a Partial Differential Equation? 

This is a good question. It turns out that there is an entire arsenal of methods 
available to the practitioner: the most important methods are those that change 
PDEs into ODEs. Ten useful techniques are 


1. Separation of Variables. This technique reduces a PDE in n variables 
to n ODEs. 

2. Integral Transforms. This procedure reduces a PDE in n independent 
variables to one in n - 1 variables; hence, a PDE in two variables could 
be changed to an ODE. 

7>. Change of Coordinates. This method changes the original PDE to an 
ODE or else another PDE (an easier one) by changing the coordinates 
of the problem (rotating the axis and things like that). 

4. Transformation of the Dependent Variable. This method transforms 
the unknown of a PDE into a new unknown that is easier to find. 

5. Numerical Methods. These methods change a PDE to a system of 
difference equations that can be solved by means of iterative techniques 
on a computer; in many cases, this is the only technique that will work. 
In addition to methods that replace PDEs by difference equations, there 
are other methods that attempt to approximate solutions by polynomial 

• • surfaces'(spline approximations). 

6. Pertubation Methods. This method changes a nonlinear problem into 
a sequence of linear ones that approximates the nonlinear one. 

7. Impulse-response Technique. This procedure decomposes initial and 
boundary conditions of the problem into simple impulses and finds the 
response to each impulse. The overall response is then found by adding 
these simple responses. 

8. Integral Equations. This technique changes a PDE to an integral equa- 
tion (an equation where the unknown is inside the integral). The integral 
equation is then solved by various techniques. 

■■9.'- Calculus of Variations Methods. These methods find the solution to 
PDEs by reformulating the equation as a minimization problem. lt turns 
out that the minimum of a certain expression (very likely the expression 
will stand for total energy) is also the solution to the PDE. 

10. Eigenfunction Expansion. This method attempts to find the solution 
of a PDE as an infinite sum of eigenfunctions. These eigenfunctions are 
found by solving what is known as an eigenvalue problem corresponding 
to the original problem. 


Kinds of PDEs 

Partial differential equations are classified according to many things. Classify 
cation is an important concept because the general theory and methods 
of solution usually apply only to a given class of equations. Six basic classifi- 
cations are 

1 . Order of the PDE. The order of a PDE is the order of the highest partial 
derivative in the equation, for example. 

u, = u x , (second order) 
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“f = «, (first order) 

u < ~ + sin .r (third order) 

1 N “” l , ber , ° fVa " abt ? s - The number of variables is the number of inde- 
pendent variables, for example, 1 

u > = u rx (two variables: x and /) 
u m ^ 1 1 

~u r + ^u m (three variables: r, 0, and r) 

3 ' I / l"!u ar [. 0 ' - Partial 5 ferential equations are either linear or nonlinear 
n 1 lineT a t r T*’ / u dependent variable “ ™d all its derivatives appear 
. J. tashlon , (th , e y are not multiplied together or squared, foex- 
ampie). More precise y, a second-order linear equation in two variables 
is an equation of the form 



£?*££*? F - and c can be comana or siven funahns <* 

u„ = e~'u„ + sin t (linear) 
uu xt + u, = 0 (nonlinear) 

M « + y u yy = 0 (linear) 

xu * + y u > + = 0 (nonlinear) 

T he e 3 uati0n (L1 ) is cal,ed homogeneous if the right- 
hand side G(x,y) is identically zero for all jc and y. If G(;c,y) is not 
identically zero, then the equation is called nonhomogeneous. 

5. kinds of Coefficients If the coefficients A, B, C, D, £, and Fin equation 
“ (1-1) are-constams, then (1,1) is said to have constant coefficients (other- 

wise, variable coefficients). 

6 ’ l\ r iUre%hef eS ° f **** Equati ° ns - A11 linear PDE ? like equation 

(a) parabolic 

(b) hyperbolic 

(c) elliptic 

Parabolic. Parabolic equations describe heat flow and diffusion processes' 
and satisfy the property B 2 - 4AC = 0. . processes 

Hyperbolic. Hyperbolic equations describe vibrating systems and wave mo- 
tion and satisfy the property B 2 - -MC >0 

fXny “ d “'^y <l» 
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Examples. . 


(3) 

“» = “« 

B 2 - 4AC = 0 

(parabolic) 

(b) 


B 2 - 4 AC = 4 

(hyperbolic) 

(c) 

u„-- 0 

B 2 - 4 AC = 1 

(hyperbolic) 

(d) 

«*- '+ 

= 0 B 2 - 4AC 

= -4 (elliptic) 

(e) 

yu„ + u y 

y = 0 B 2 - 4AC 

f elliptic for v > 0 
= -4y [ parabolic for y = 0 

[hyperbolic for y < 0 


(In the case of variable coefficients, the situation can change from point to 

point.) 

NOTES 

1. In general, B 2 - 4AC is a function of the independent variables; hence, an 
equation can change from one basic type to another throughout the domain 
of the equation (although it’s not common). 

2. The general linear equation (1.1) was written with independent variables 
x and y. In many problems, one of the two variables stands for time and 
hence would be written in terms of x and t. 

3. A general classification diagram is given in Figure 1.1. 



FIGURE 1.1 Classification diagram for partial differential equations. 
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PROBLEMS 


1. Classify the following equations according to all the properties we've dis- 
cussed in Figure 1 .1: 

(a) u, = u a , +2 k, + u 

(b) u, - u„ - c--- 

(c) u xx + 3m„ + u vl = sin x 

(d) u„ = uu xxxx + e" 

2. How many solutions to the PDE u, - can you find? Try solutions of the 
form u(x,t) ** e“ * 1,1 . 

3. If u,(x,y) and u 3 (x,y) satisfy equation (1.1), then is it true that the sum 
satisfies it?; if yes, prove it. 

4. Probably the easiest of all PDEs to solve is the equation 

Hx,y) = 0 

dx 

Can you solve this equation? (Find all functions u(x,y) that satisfy it.) 

5. What about the PDE 

* 2 u(x,y) = Q [ 

dxdy • : 

Can you find all solutions u(x,y ) to this equation? (How many are there?) f'j* • 

How does this compare with an ODE like 



insofar as the number of solutions is concerned? 

OTHER READING 

1. Elementary Partial Differential Equations by P . W. Berg and J. L. McGregor. Holden- 
Day, 1966. Clearly written with several nice problems; a nice book to own. 

2. Analysis and Solution of Partial Differential Equations by R. L. Street. Brooks-Cole, 1973. 
A well-written text covering many of the topics we will cover in this book. 
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PART 2 




LESSON 2 


Diffusion-Type Problems (Parabolic 
Equations) 



PURPOSE OF LESSON: To show how parabolic PDEs are used to 
model heat-flow and diffusion-type problems. The physical meaning of 
different terms (such as i<„ a,, u and u) are explained and a fesv examples 
of parabolic equations presented. 

The idea of an initial-boundary -value problem is introduced along with 
an example. One of the major goals of this lesson is to give the reader an 
intuitivgjgeling for parabolic-type problems. 


We begin this lesson by introducing a simple physical problem and showing how 
it can be described bvm.eans of a mathematical model (which will involve a 
PDE). We then cofti^ncate the problem and show how new partial differential 
equations can describe the new situations. The partial differential equations in 
this lesson are not derived or solved now. but will be in later lessons. 


A Simple Heat-Flow Experiment 

Suppose we have the following simple experiment that we break into steps: 

STEP 1 We start with a reasonably long (say L = 2 m) rod (say copper) 2 cm 
in diameter whose lateral sides (but not the ends) we wrap with insulation. We 
could even use copper tubing provided we pour some sort of insulation down 
the inside. In other words, heat can flow in and out of the rod at the ends, but 
not across the lateral boundary. 

STEP 2 Next, we place this rod in an environment whose temperature is fixed 
at some temperature T.„ (degrees *C) for a sufficiently long time. >o that the 
temperature of the entire rod comes to a steady-state temperature similar to 
the environment. For simplicity, we let the temperature of the environment 
T„ = 10°C. 
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STEP 3 We take the rod out of the environment at a time that we call t = 0 
and attach two temperature elements to the ends of the rod. The purpose of these 
elements is to keep the ends at specific temperatures 7, and 7, (say 7, = 0°C 
and T 2 = 50°C). In other words, two thermostats constantly monitor the tem- 
perature at the ends of the rod, and if the temperatures differ from their pre- 
scribed values 7, and T z . strong heating (or cooling) elements come into 
operation to adjust the temperature accordingly. Our experiment is illustrated 
in Figure 2.1 



profile at different values of time 


FIGURE 2.1 Schematic diagram of the experiment. 

STEP 4 We now monitor the temperature profile of the rod on some type of 
displav. (Why we want to perform an experiment of this kind is another question; 
we wiil talk about that later.) This completes our discussion of the experiment. 
The main purpose of this lesson is to show how this physical problem (and 
variations of it) can be explained (modeled) by parabolic PDEs. 

The Mathematical Model of the Heat-Flow Experiment 

The description of our physical problem requires three types of equations 

1. The PDE describing the physical phenomenon of heat flow. 

2. The boundary conditions describing, the physical nature of our problem 
on the boundaries. 

3. The initial conditions describing the physical phenomenon at the start of 
the experiment. 
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The Heat Equation 

The basic equation of one-dimensional heat flow is the relationship 
(2.1) | PDE i, t = a : rr w » < -v < L 0 < t < s. | 

which relates the quantities 

u, = the rate of change in temperature with respect to time 
(measured in deg/sec) 

and 

u x* ~ ‘tie cot/cavity of the temperature profile u(x,t) (which 
essentially compares the temperature at one point to 
“ the temperature at neighboring points). 

This equation will be derived from the basic conservation of heat equation in 
later lessons, but for the time being, we examine it by itself. This equation 
simply says that the temperature u(x,t ) (at some point along the rod jr and at 
some point in time t) is increasing (u, > 0) or decreasing (u, < 0) according to 
whether u xx is positive or negative. Figure 2.2 illustrates the change in temper- 
ature at different points along the rod. 



FIGURE 2.2 Arrows indicating change in temperature according to 
u, = a 1 

To see how can be interpreted to measure heat flow, suppose we approximate 
u xx by the difference quotient 

s ~ [w( A - + Ar.r) - 2 u(x.t) + u(x - Ajc,r)] 
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Since this can be rewritten 




we have the following interpretation of u xx : 

1. If the temperature u(x,t) < average of the two neighboring temperatures, 
then u xx > 0 (here, the net flow of heat into x is positive). 

2. If the temperature u(x,t) = average of the two neighboring temperatures, 
then u xx = 0 (here the net flow of heat into x is zero). 

3. If the temperature u(x,t) > average of the two neighboring temperatures, 
then u xx < 0 (here the net flow of heat into x is negative). 

This is illustrated in Figure 2.2. In other words, if the temperature at a point 
x is greater than the average of the temperature at two nearby points r — , \r 
and * + A*, then the temperature at .r will be decreasing. Furthermore, the 
exact rate of decrease u, is proportional to this difference. The proportionality 
constant or is a property of the material, and we will discuss this constant more 
in the next few lessons. 


Boundary Conditions 

All physical problems have boundaries of some,kjnd. so we must describe math- 
ematically what goes on there in order to adfecftfately describe the problem. In 
our experiment, the boundary conditions (BCs) are quite easy. Since the tem- 
perature u was fixed for all time t > 0 at T, and 7V at the two ends * = 0 and 
X = L, we would simply say 


( 2 . 2 ) 


BCs 


f u(o,o = r, 
1 u(L,o = r, 


0 < / < CO 


Initial Conditions 

All physical problems must start from some value of time (generally called 
t - 0), so we must specify the physical apparatus at this time, Since we started 
monitoring the rod temperature in our example from the time the rod had 
achieved a constant temperature of T u , we have 

(2.3) 

We have now mathematically described the experiment. By writing equations 
(2.1), (2.2), and (2.3) together, we have what is called an iniiial-boundarv-value 
problem (IBVP) 



14 Diffusion-Type Problems 


PDE u, = a -u„ 0 < x < L 0 < t <x 

<2A) BCs {^>:^ «<,<» 

IC u(x, 0) = T 0 0 < x < L 

The interesting thing here, which is not at all obvious, is that there is only one 
function u(x,t) that satisfies the problem (2.4), and that function will describe 
the temperature of the rod. Hence, our goal in the near future will be to find 
that unique solution u(x,t) to (2.4). 

Before finishing this lesson, we will discuss some variations of this basic 
problem. We start with a few modifications of the heat equation u, = a : u, x . 

More Diffusion>Type Equations 

, Lateral Heat Loss Proportional to the Temperature Difference 

The equation 

u, = a 2 u xx - P (u - u 0 ) (3 > 0 

describes heat flow in the rod with both diffusion a ! u a along the rod and heat loss (or 
across the lateral sides of the rod. Heat loss (u > «„) or gain ( u < u„ ) is proportional 
to the difference between the temperature u(x,t) of the rod and the surrounding medium 
«o (with p the proportionality constant). If p is very large in contrast to a : , then the flow 
of heat back and forth along the rod will be small in contrast to the flow in and out the 
sides, and, hence, the heat will drain out the sides (at each point) according to the 
approximate equation u, - -p (u - «„). 

In chemistry- where t/-may stand-for concentration, the equation 
u, = cru, t - p(u - u„) 

says that the rate of change t«^ of the substance is due both to the diffusion 
a : u„ (in the .r-direction) and to the fact that the substance is being created (i / < «„) or 
destroyed (« > n 0 ) by a chemical reaction proportional to the difference between two 
concentrations u and u 0 . 

internal Heat Source 

The nonltomogeneous equation 

u, = «-</., + f{x, t) 
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corresponds to the situation where the rod is being supplied with an internal 
heat source (everywhere along the rod and for all time /). It may be that a wire 
carrying electrical current passes through the rod and the resistance generates 
a constant heat source f(x, t) = K. 

Diffusion-convection Equation 

Suppose a pollutant is being carried along in a stream moving with velocity v. 
It is obvious that the concentration u{x,t) of the substance changes as a function 
of both a- (positive x measures the distance downstream) and time t. The rate 
of change u, is measured by the diffusion-convection equation 

u, = ot 2 u xx - vu x 

The term a 2 u xx is the diffusion contribution and - vu, is the convection com- 
ponent. .Whether the pollutant primarily diffuses or convects depends on the 
relative size of the two coefficients a J and v. You have probably seen smoke 
rising from a smoke stack. Here, the smoke particles are convected upward with 
the hot air and, at the same time, diffuse within the air currents. 

In addition to these modifications in the heat equation, the boundary conditions 
of the rod can also be changed to correspond to other physical situations. We 
will discuss some of these modifications in Lesson 3. 


NOTES 

The heat equation u, = a 2 (x)u xx with a variable coefficient a(x) would correspond 
to a problem where the diffusion within the rod depends on x (the material is 
nonhomogeneous). For example, if copper and steel slabs were placed next to 
each other (see Figure 2.3) and if the left side of the copper slabs were fixed at 


/ 

t A i 

a(O.r) =0"C / 



Copper / 


ji 


'f 

^ f 


o u 2 L 


FIGURE 2.3 
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u(O.r) 0°C and the right side of the steel sheet were fixed at u(L,t) = 20°C, 
then the PDE that describes the heat flow would be 

u, = a 7 (x)u x , 0 < x < L 

where c*(a) = i (fusion coefficient of copper) 0 < a < LI 2 
[a, (diffusion coefficient of steel) L'2 < x < L 


PROBLEMS 


1. If the initial temperature of the rod were 

m(a, 0) = sin tt.v 0 ^ a s 1 

• and if- the BGs were 


w(0,r) = 0 
«(l,r) = 0 

what would be the behavior of the rod temperature u(x,t) for later values 
of time? .;.!>£;■ 

HINT Use the physical interpretation of the heat equation u, = d 2 u„. 

2. Suppose the rod has a constant internal heat source, so that the basic equa- 
tion describing the heat flow within the rod is ' 

u, = a 2 u xx + 1 0 < a < 1 

Suppose we fix the boundaries' temperatures by u(O.r) = 0 and 
«(I,r) = 1. What is the steady-state temperature of the rod? In other words, 
does the temperature u(x,t) converge to a constant temperature U(x) in- 
dependent of time? 

HINT Set u, = 0. It wovld be useful to graph this temperature. Also start 
with an initial temperature of zero and draw some temperature profiles. 

3. Suppose a metal rod loses heat across the lateral boundary according to the 
equation 

u, = o ru xx - pu 0 < a < 1 

and suppose we keep the ends of the rod at u(0,l) = 1 and u(l,r) = 1. Find 
the steady-state temperature of the rod (graph it). Where is heat flowing 
in this problem? 

4. Suppose a laterally insulated metal rod of length L = 1 has an initial tem- 
perature of sin (3ita) and has its left and right ends fixed at temperatures 
zero and 10°C. What would be the IBVP that describes this problem? 

*Noie lhal Ihe boundary and initial data do noi maich up in this problem. 
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OTHER READING 


I. Equations of Mathematical Physics by A. N. Tikhonov and A- A. Samarskii. Macmillan. 
1963; Dover, 1990. An encyclopedia of information; contains many good examples and problems. 
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When describing the various types of boundary conditions that can occur for 
heat-flow problems, three basic types generally come to mind. Lesson 3 discusses 
these three kinds of BCs and gives an example of how they occur in experiments. 

Type 1 BC (Temperature specified on the boundary) 

Consider the heat flow in the one-dimensional rod illustrated in Figure 3.1 
and suppose we make the ends of the rod follow the temperature curves g,(f) 
and g 2 (r). 



FIGURE 3.1 Temperature specified on the boundary. 
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As we mentioned in the previous lesson, an apparatus. that keeps the ends at 
specified temperatures requires a thermostat at each end and heating elements 
to adjust the temperature accordingly. Problems with BCs of this kind are fairly 
common. It may even be that the goal of the problem is to find the boundary 
temperatures (boundary control) g,(t) and g ; (t) that will force the temperature 
to behave in a suitable manner. In the steel industry, it is often necessary 
to determine the boundary controls so that the temperature of the metal inside 
the furnace changes over time but the temperature sradient from one point to 
another is small. 

Similar types of BCs also, apply to higher dimensional domains, for example, 
in two dimensions, we could imagine the interesting problem of finding the 
temperature inside the circular disc (of radius R) when the boundary temperature 
is specified in polar coordinates to be 

tt(R.D.t) = cos t sin 0 

See Figure 3.2. 





FIGURE 3.2 Oscillating boundary temperature. 


Of course, we’d have to have an initial temperature to get this experiment 
started, but in this case, the effects of our IC would vanish after 3 short period 
of time, and the resulting temperature inside the circle would depend on the 
boundary temperature. 


Type 2 BC (Temperature of the surrounding medium 
specified) 

Suppose we consider again our laterally insulated copper rod. but now instead 
of requiring the two boundaries to be specified at temperatures g,(r) and g,(r). 
we only bring them in contact with 'urrounding mediums that have those tem- 
peratures. In other words, suppose the left side of the rod is enclosed in a 
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“" t < ! in ® rof Iic > u ’ d tl \ at has a hanging temperature g,(r), while the right end is 
enclosed in another liquid with temperature g,(r) (Figure 3.3) 


icmperaiure^jUl 

FIGURE 3.3 Convection cooling of the boundaries. 

By specifying these types of BCs. we cannot say the boundary temperatures of 
the rod w.ll be the same as the liquid temperatures g,(t) and $,</). but we do 
know (Newton s law of cooling) that whenever the rod temperature at one of 
the boundaries is less than the respective liquid temperatures, then heat will 
low into the rod at a rate proportional to this difference. In other words, for 
.the 'One-dimensional rod with boundaries at a = 0 and L. Newton s law of 
cooling states 

(3.1) (Outward fhTx of heat (at a- = 0) = h\u(6.t) - g,(t) } 

(Outward flux of heat (at x = L) = h\u(L,t) - g 2 (t) J 

where his a heat-exchange coefficient, which is a measure of how many calories flow 
across the boundary per unit of temperature difference per second per cm and the 
outward flux of heat is the number of calories crossing the ends of the rod per 
second. Note that the outward flux of heat will be positive at either end provided 
: theAemperature of the rod is greater than the surrounding medium. Equations 
(3.1) can now be used m conjunction with what is known as Fourier’s Law of 
Cooling to arrive at our BCs. Fourier’s law gives us another representation (the 
first one is 3.1) for the outward flux of heat and bv setting these two represen- 
tations equal to each other, we get our BCs. First, we state Fourier’s law (proven 
experimentally): 

(3 0utward flux of heat across a boundary is proportional to the inward 
v ’ normal derivative across the boundary. 

This law says that if the temperature is increasing rapidly in the direction outward 
from the boundary of D (Figure 3.4), then heat will flow from the surrounding 
medium into the domain D. 

In our one-dimensional problem. Fourier’s law takes the form: 


(Outward flux of heal (at x = 0) = k - 
[outward flux of heat (at a = L) = - 
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FIGURE 3.4 Illustration of Fourier's law. 


where k is the thermal conductivity of the metal, which is a measure of how well 
the material conducts heat. (Poorly conducting materials have values near zero 
in cgs. units, while copper and aluminum have values close to one.) 

Fourier’s law (3.3) actually holds anywhere inside the rod and not just at the 
boundary; for example, 



See Figure 3.5. 



FIGURE 3.5 Another illustration of Fourier's law. 

Fourier’s law (3.4) says that if u,(.» < 0. then heat will (low from left to right: 
if u x (x m t) > 0. then the flow of heat through point ,r„ will be from right to left 
(heat always flows from high to low temperatures). 
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Finally, if we use the two expressions (3.1) and (3.3) for heat flux, we have 
our desired BCs for Figure 3.3 in purely mathematical terms; namely. 


pr--; -*■(',] 

Quite often, the constant hlk is simply written as X, and so we have the BCs for 
heat flow across the boundary 

(3.5) “.(0,0 = ^ [«(0,0 - g,( 0] 

u£L,t ) = -X [u(L,t) - g 2 (r)] 

In higher dimensions, we have similar BCs; for example, if the boundary of 
a circular disc is interfaced with a moving liquid that has a temperature g(0,f), 
our BC would be . 

f r (R,Q,t) = - \ [u(R,Q,t) - g(9,r)] 

Here, j -(R,0,t) represents the outward normal derivative (in the positive 

r-direction) of u evaluated at a point (R,0) on the boundary. This type of BC 
would be called a linear BC (since it is linear in u and u,) but nonhomogeneous 
due to the right-hand side g(0,r). 


Type 3 BC (Flux specified— including the special case of 
insulated boundaries) 

Insulated boundaries are those that do not allow any flow of heat to pass, and, 
hence, the normal derivative (inward or outward) must be zero on the boundary 
(since the normal derivative is proportional to the flux). In the case of the one- 
dimensional rod with insulated ends at x = 0 and x = L, the BCs are 

“.(°.0 = ° 0<f<x 
“,(M = o 

In two-dimensional domains, an insulated boundary would mean that the 
normal derivative of the temperature across the boundary is zero. For example, 
if the circular disc were insulated on the boundary, then the BC would be 
u r (R,ti.t) = 0 for all 0 « 0 < 2 tt and all 0 < / < *. 
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On the other hand, if we specify the amount of heat entering across the 
boundary of our disc, the BC is 

u r (R. 0,n = /(0,r) 

where /(tt.tj would represent the amount of heat crossing into the circular disc 
from an outside heating source. 

Wc now illustrate different types of BCs. 

Typical BCs for One-Dimensional Heat Flow 

Suppose we have a copper rod 200 cm long that is laterally insulated and has 
an initial temperature of 0°C. Suppose the top of the rod (a- = 0) is insulated, 
while the bottom l.v = 200) is immersed in moving water that has a constant 
temperature of g 2 (i) = 20°C (Figure 5.6). 


U, (0. ii •= o 
(insulated at x » 0) 



FIGURE 3.6 Initial-boundary-value problem. 

The mathematical model for this problem would be the following four 
equations: 

PDE u, = a 2 u x „ 0 < x < 200 0 < f < « 


(3.6) BCs 


'h,(0.0 = 0 

' «,(200,0 = -~ k [«(200.0 - 20] 


1C u( a\ 0) = 0°C 0 =s a: =s 200 



JL. 
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where 


or - 1.16 cnr/sec (diffusivity constant for copper) 
k = 0.93 cal/cm-sec°C (thermal conductivity of copper) 
h = heat exchange coefficient. To find It is a hard problem in itself. It 
measures the rate that heat is being exchanged between the bottom 
of the rod and the surrounding water. It is a function of how fast the 
water is being circulated, the nature of the interface, and so forth. 
The reader would have to carry out an experiment to determine its 
value. 

NOTES 

1, A typical heat-flow problem inside a square is shown in Figure 3.7. 



#(*,0.<l If) 

(Temperature fixed at;, (t) ) 

FIGURE 3.7 Typical BCs for diffusion problems inside a square. . 

In this problem, after we specify the initial temperature u(a-,v,0) at t - 0 
inside the square, the PDE and BCs in the diagram will take over for 0 < 
l < oc and determine the subsequent temperature values u{x,y,t). Whatever 
the temperature is, however, it must satisfy the BCs in Figure 3.7. 

2. Note that the BC 

u r (R,0,r) = -^lu(R.e.r) - g(6, 0] 

on the circle will not require the boundary temperature to be g(0.r). but 
when the heat-exchange coefficient h is large, then the BC essentially says 
that the boundary temperature u(/?,0,r) is almost equal to £(0,f). 
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PROBLEMS 


1. Draw rough sketches of the solution to the IBVP (3.6) for different values 
of time. Do your sketches satisfy the BCs? What is the steadv-state tem- 
perature of the rod? Is this obvious based on your intuition* ' 

2. What is your interpretation of the initial-boundary-value problem? 

PDE u, = a 2 u xx 0 < jc < 1 0 < e < x 

B ° tef.°i •<«<■ 


JC u(. x,0) = sin (irjr) 0 ^ x « 1 

Can you draw rough sketches of the solution for different values of time* 
.. Will the solution come to a steady state; is this obvious? 

3. What is your physical interpretation of the problem? 

0<* < 1 0 < f < » 

0 < f < ao 


IC u(x, 0) = sin (to) 0 « ,r «s 1 

Can you draw rough sketches of this solution for various values of time* 
What about the steady-state temperature? 

nrt<£?° Se 3 mCtal rod laterall y insu,ated ha s an initial temperature of 
20 C but immediately thereafter has one end fixed at 50 # C. The rest of the 
rod is immersed in a liquid solution of temperature 30°C. What would be 
the IBVP that describes this problem? 


OTHER READING 

i- fTotrr ° fH T SolidS by H ' S - Carslaw and J - C - Jae S er - Oxford University 
Press. 1959. An excellent reference that discusses BCs of many physical problems. 

2. Partial Differential Equations in Biology by C. S. Peskin. Couram Institute of Math- 
ematical Sciences, 1976. Several biological phenomena such as nerve cells, the inner ear 
and the cardiovascular system are modeled by PDEs. 
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LESSON 

Derivation of the Heat Equation 


PURPOSE OF LESSON: To show how the one-dimensional heat 
equation 

u, = aru„ + f(x,t) 

is derived from the basic principle of conservation of heat. Physical concepts 
such as thermal conductivity, thermal capacity, and density are discussed, 
and it is shown how the rate of heat transfer depends on these three basic 
physical parameters. A few variations of the basic heat equation are also 
discussed. 


In all areas of science, we begin with a given set of assumptions that are taken 
to be self-evident and from which all other ideas are derived. Of course, what 
is self-evident to one person may hold doubts for others. The history of science 
consists of pushing back the basic axioms further and further so that there is a 
universally agreed upon starting point. 

For example, one person may think that all relevant facts will spring from a 
basic assumption, say assumption B. From assumption B, he or she may prove 
theorem C, which in turn proves theorem D, which in turn proves others (Figure 
4.1). ... 


FIGURE 4.1 The axiomatic method. 

This of course is progress — the more new results a person can prove, the better. Physi- 
cists, chemists, and biologists all proceed in this basic manner. 

On the other hand, instead of proving new theorems we may ask if it is 


B. so that assumption B can be proven 
back the frontiers of knowledge. In the 
of conservation of energy theat energy ) i 
are derived (Figure 4.2). 


which other principle; 
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FIGURE 4.2 Conservation of energy: the cornerstone of heat-flow problems. 

We could, ol course, force; this lesson and use the heat equation as the 
starting point (some people may think it is self-evident in itself), but this would 
be shortchanging serious students, since conservation of energy assumptions are 
basic to science. Scientists often begin modeling specific problems by writing 
conservation of energy relationships and then rewriting them as partial differ- 
ential equations. 

We now turn to the goal of the lesson — to derive the heat equation from the 
conservation of heat equation. 


Derivation of the Heat Equation 

Suppose we have a one-dimensional rod of length L for which we make the 
following assumptions: 

1. The rod is made of a single homogeneous conducting material. 

2. The rod is laterally insulated (heat flows only in the x-direction). 

3. The rod is thin (the temperature at all points of a cross section is constant).. 



Thin Conducting Rod 


FIGURE 4.3 Thin conducting rod. 

If we apply the principle of conservation of heat to the segment \x,x + Ax], we 
can claim 

Net change of heat inside [jc.jc + Ax] 

(4.1) = Net flux of heat across the boundaries 

+ Total heat generated inside [x.x + Ax] 

Now, inasmuch as the total amount of heat (in calories) inside \x,x + Ax] at 
any time / is measured by (see reference 1 in this lesson) 

Total heat inside [x,x + Ax] = | cpAu(s.t) ds 

where 
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c = thermal capacity of: the rod (measures the ability of the rod to store 
heat). 

p = density of the rod. 

A = cross-section area of the rod 


we can write the conservation of energy equation (4.1) via calculus as 

(4.2) — | cpAu(s,t ) ds = cpA jf u,(s,t ) ds 

= kA [u,(.v + Ax./) - u,(x.t)] + A f t f(s,t) ds 

where 

k - thermal conductivity of the rod (measures the ability to conduct 
heat). 

f(x.t) = external heat source (calories per cm per sec). 

The problem now is to replace equation (4.2) by one that does not contain 
integrals. The reader may recall the Mean Value Theorem from calculus. 

Mean Value Theorem 

If/(x) is a continuous function on [a, 8], then there exists at least one number 
fj, a <£ < f> . that satisfies 

[ f(x)dx = /(£) (b - a) 

Applying this result to equation (4.2), we arrive at the following equation: 
cpAu,(t, v t)bx - kA[u x (x + Ax,z) - u,(x.t)\ + Af(i 2 ,t) Ax x < i < x + Ax 

uXlJ) = ~ f — + ^ 

cp 1 Ax 

Finally letting Ax — * 0, we have the desired result 



(4.3) 

where 
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(called the diffusivity of the rod) 


, = k_ 

cp ^ 

F( x <‘) = — f{x ,/) (heat source density) 

This completes our discussion. Before we close, however, suppose the rod were 
not laterally insulated and that heat can flow in and out across the'lateral bound- 
ary at a rate proportional to the difference between the temperature u(x t ) and 
the surrounding medium that we keep at zero. In this case, the conservation of 
heat principle will give. 

( 4 - 4 ) «, = a 3 u„ - pu +.F(x,t) 

where p = rate constant for the lateral heat flow (p > 0). 


NOTES 

1. The constant k is the thermal conductivity of the rod and a measure of the 
heat flow (in calories) that is transmitted per second through a plate 1 cm 
thick across an area of 1 cm 2 when the temperature difference is 1°C; values 
for k can be found in The Handbook of Chemistry and Physics. Typical 
values of k are close to 1 for copper and near zero for insulatine-type 
materials. 6 w 

If the material of the rod is uniform, then k will not depend on x. For 
some materials, the value of k depends on the temperature u and hence the 
heat equation 


is nonlinear. Most of the time, however, k changes very slowly with u and 

— this. nonlinearity- is- neglected, 

The constant c is known as the thermal capacity (or specific heat) of the 
substance and measures the amount of energy the substancd can store. For 
example, a baked potato would have a large thermal capacity, since it can 
store a large amount of heat per unit mass of potato (that’s why it takes a 
long time to heat). Technically, the thermal capacity is the amount of heat 
(in calories) necessary to produce a 1°C change in temperature of 1 g of the 
substance. For most of our problems, c is taken as a constant independent 
o x and ir. typical values can be found in The Handbook of Chemistry and 
Physics. 

The units of some of the basic quantities of heat flow (in the cgs. measure- 
ment system) are 

u = temperature (degrees centigrade). 
u, = rate of change in temperature (°C/sec). 


30 Diffusion-Type Problems 


u x = slope of temperature curve (°C/cm). 

u xx = concavity of temperature curve (°C/cm 2 ). 

c = thermal capacity (cal/g-°C). 

k = thermal conductivity (cal/cm-sec-°C). 

p = density (g/cm 3 ). 

a 2 = diffusivity (cm 2 /sec). 

4. Note that the diffusivity a 2 = — of a material is proportional to the con- 
ductivity k of the material and inversely proportional to the density p and 
thermal capacity c; this should have some intuitive appeal to the reader. 


PROBLEMS 

1. Substitute the units of each quantity u,u„ . . . into the equation 

u, = a 2 u xx - pu 

to see that every term has the same units of °C/sec. 

2. Substitute the units of each quantity into the equation 

u, = a 2 u xx - vu x 

where v has units of velocity to see that every term has the same units. 

3. Derive the heat equation 

for the situation where the thermal conductivity k(x) depends on x. 

4. Suppose u(x,t ) measures the concentration of a substance in a moving stream 
(moving with velocity v). Suppose the concentration u(x,t) changes both by 
diffusion and convection; derive the equation 


from the fact that at any instant of time, the total mass of the material is 
not created or destroyed in the region [x,x + lx]. 

HINT Write the conservation equation 


Change of mass inside [x,.v - Ax] 

= Change due to diffusion across the boundaries 
+ Change due to the material being carried across the boundaries 
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OTHER READING 


1. Applied Mathematics lor the Engineer and Physicist l\v L. A. Pipes. McGraw-Hill. 
1958. An older reference, but still a good one for the practicing scientist. 

2. Equations of Mathematical Physics by A. N. Tikhonov and A. A. Samarskii. Mac- 
millan. 196.': Dover. 1990. A good text for derivation? of equations. A companion volume. 
A Collection of Problems in [on] Mathematical Physics, by B. M. Budak. A. A. Samarskii, and 
A . N. Tikhonov (Peigamon. I9 (h. Dover. I988i is available, which will give the student additional 
experience with solving problems in partial differential equations. 
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LESSON 


Separation of Variables 


PURPOSE OF LESSON: To introduce the powerful method of sep- 
aration of variables and to show how this method can be used to solve a 
well-known diffusion problemllhasmuch as the method is not well under- 
stood by some students due/to its complicated algebraic nature, several 
intuitive explanations are given along the way. 

The basic idea is to bre'Sk down the initial conditions of the problem 
into simple components, find the response to each component, and then 
add up these individual responses. This gives the response to the arbitrary 
initial condition. 

The actual step-by-step methodology of separation of variables some- 
what hides this basic interpretation, but that’s what’s going on nevertheless. 


Separation of variables is one of the oldest techniques for solving initial- 
boundary-value problems (IBVPs) and applies to problems where 

1. The PDE is linear and homogeneous fnot necessarily constant coeffi- 
cients)] 

2. The boundary conditions are of the form 

au r (0.t) + 3u(0.t) = 0 
yu/l.t) + 8u(l.f) = 0 

where a, p, y, and 5 are. constants (boundary conditions of this form are 
called linear homogeneous BCs). 

It dates back to the time of Joseph Fourier (in fact, it s occasionally called 
Fourier's method) and is probably the most widely used method of solution 
(when applicable). 

Instead of showing how the method works in general, let's apply it to a specific 
problem (later we will discuss it in more generality). Consider the 1BVP (dif- 
fusion problem) 
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IC u(x,0) = <J>(jc) 0 =s X s 1 



FIGURE 5.1 Diagram of the diffusion problem. 

Before getting to separation of variables, let’s first think about our problem. 
Here we have a finite rod where temperature at the ends is fixed at zero (suppose 
it s ai temperature problem where zero means so many degrees). We are also 
given data for the problem in the form of an initial condition; our goal is to find 
the temperature u(x,i) at later points in time. 

N6w for the method itself— but first an overview. 

Overview of Separation of Variables 

Separation of variables looks for simple^type solutions to the PDE of the form 
«M = X(x)T(t) 

where X(x) is some function of * and T(t) is some function of t. The solutions 
are simple because any temperature u(x,t) of this form will retain its basic 
shape for different values of time i (Figure 5.2). 



FIGURE 5.2 Graph of X(x)T(t) for different values of t. 


?* ** Tn? ! d l a k h3t I! ‘ S possible t0 find an inf * n i f e number of these solutions 
P r° E s S? S3me time ’ also satisf y the BCs )- These simple func- 

tions «„(*,/) - X„(x)T„(t) (called fundamental solutions) are the building blocks 
of our problem, and the solution u(x,t ) we are looking for is found bv adding 
the simple fundamental solutions .Y.,(.v)r„(r) in such a way that the resulting sum 

t A.,X„(x)U0 
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satisfies the initial conditions. Inasmuch as this sum still satisfies the PDE and 
the BCs, we now have the solution to our problem. Let’s now carry this out in 
detail. 


Separation of Variables 

STEP 1 (Finding elementary solutions to the PDE) 

We wish to find the function u(x,t) that satisfies the following four conditions: 


IC u(x,0) = d> (x) 0 *£ x « 1 

To begin, we look for solutions of the form u(x,t) = X(x)T(t) by substituting 
X(x)T(t) into the PDE and solving for X(x)T(t). Making this substitution gives 

X(x)T’(t) = a i X"(x)T(t) 

Now, here is the part that makes all this work: If we divide each side of this 
equation by a 2 X(x)T(t), we have 

T'(t) X'(x) 

« 2 T(r) ‘ X(x) 

and obtain what is called separated variables, that is, the left side of the equation 
depends only on t and the right side, only on x. Inasmuch as .r and t are inde- 
pendent of each other , each side must be a fixed constant (say k)\ hence, we can 


or 

T - ka 2 T = 0 

r - kX - 0 

So now we can solve each of these two ODEs, multiply them together to get 
a solution to the PDE (note that we have essentially changed a second-order 
PDE to two ODEs). However, we now make an important observation, namely, 
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that we want ihe separaiion constant A to be negative (or etse the 7 “(r) factor 
doesn t go to zero as t — * '■'•). With this in mind, it is gen oral practice to rename 
k - ~k : . where k is nonzero ( -A : is guaranteed to be negative). Calling our 
separation constant b\ its new name, we can now write the two ODEs as" 

T + a-VT = 0 


.Vv e will now solve these equations. Both equations are standard-type ODEs and 
have solutions r r . 

> e. [JgWc d, + c 

7T/) = (4 an arbitrary constant) 

A'(a) = 4 sin (Aa) + B cos ( Av) (4, Z? arbitrary) 

and hence all functions 

u(x,t) = e [4 sin (Ar) + 5 cos (Ac)}. - ...... 

( with 4. B. and A arbitrary) will satisfy the PDE u, = a : u„; this verification is 
problem 1 in the problem set. At this point, we have an infinite number of 
functions that satisfy the PDE. 

STEP 2 (Finding solutions to the PDE and the BCs) 

We are now to the point where we have many solutions to the PDE but not all 
of them satisfy the BCs or the 1C. The next step is to choose a certain subset ’ 
of our current crop of solutions • . 

(5.1) e -xv .[4 s j n + fi cos (Ar)) 

that satisfy the boundary conditions 

tr(O.r) = 0 
u( 1 ./) = 0 

To do this, we substitute our solutions (5.1) into these BCs. getting 

//(0./) = Be B = 0 

u(l.r) = 4e~ k; " : ' sin A = 0 sin A = 0 

This last BC restricts the separation constant A from being any nonzero number, 
it must be a root of the equation sin A = 0. In other words, in order that 
i/(l./) = 0 . it is necessary to pick 

A = *rr. ±2ii. ~3 it. .-...■ 
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Note that the last BC could also imply 4 = 0. but if we choose this, we would 
get the zero solution in (5.1). 

We have now finished the second step: we have found an infinite number of 
functions 

(5.2) 

each one satisfying the PDE and the BCs.* These are the building blocks of the 
problem, and our desired solution will be a certain sum of these simple functions: 
the specific sum will depend on the initial conditions. See Figure 5.3 for the 
graphs of these fundamental solutions u„(x,l): 

STEP 3 (Finding the solution to the PDE. BCs, and the IC) 

.The last step (and probably the most interesting from a mathematical point of 
view) is to add the fundamental solutions 

u(x,t) = 2 A„e~ < '""* ,: ' sin (mix) 

in such a way (pick the coefficients A n ) that the initial condition 
. «(jt,0) = d>(*) 

is satisfied. Substituting the sum into the IC gives 

(5.3) 6 (x) = jf 4„ sin (/ittat) 

This equation leads us to the interesting question asked by the French mathematician 
Joseph Fourier, is it possible to expand the initial temperature <h(x) as the sum of the 
elementary functions as follows: 

4, sin (ttx) + A 2 sin (2irj«r) + A, sin (3nx) + . . . 

The answer to this question is yes provided <J)(a) is a reasonably nice function- 
continuous. Hence, the question now becomes how to find the coefficients 4„. 

* Notice that the functions u„ and u_„ are essentially the same except for a minus sign. 
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FIGURE '5.3 Fundamental solutions u n {x,t) = A„e~ tnm > 2 ' sin (mrx). 

This is actually very easy: One uses a property of the functions 
(sin (mrx); n = 1 , 2, . . .} 

known as orthogonality. It turns out (see problem 2) that these functions are 
orthogonal to each other in the sense 

I sin (mnx) sin (nnx) dx = m * * n 

This property can be illustrated by looking at the graphs of these functions 
(Figure 5.4). 
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FIGURE 5.4 Orthogonal sequence of functions. 

So, we are now in position to solve for the coefficients in the expression 
4>(x) = Ay sin (irx) + A 2 sin (2ir x) + A } sin (3irx) + A t sin (4-rrx) + . . . 

We multiply each side of this equation by sin (mnx) (m, an arbitrary integer) 
and integrate from zero to one; doing this, we get 

jf <j>(x) sin (/mrx) dx = A m £ sin 2 (mnx) dx = jA m 

(all other terms drop out due to orthogonality). Solving for A m gives 


A m = 2 ^ 4>(x) sin (mnx) dx 
We’re done; the solution is 



We can. check this answer to see that it satisfies all four of our original conditions 
in the problem. This ends step 3. 

Many students are disappointed when they finally discover that the solution 
is this complicated, and many hardly give the solution a second look (that’s too 
bad). The solution is not all that difficult if one takes the time to analyze it; in 
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fact, the more complicated it is. the more information it contains. Here arc a 
few notes that will help you interpret this solution. 

NOTES 

1 . Observe that the only difference between the Fourier sine expansion of 6(.r ) 
in (5.3) and the solution (5.4) is the insertion of the time factor 


in each term. Hence, if our IC were a very simple expression like 
d>(x) = sin Q-tta-) + ^ sin (3trx) 

then the solution would simply be ..._.. 

u(x,r) = sin (irx) + sin (3 tta) 

In this case, it’s obvious that if we expanded 4>(x) as a Fourier sine series, we 
would get 

A, = 1 
A 2 = 0 
A 3 = V. 2- 

= A, = . . . = 0 

2. We can interpret the solution (5.4) in the following manner: We expand the 

initial temperature <t>(x) as a sum of simple functions, A„ sin (mix) and then find the 
response to each of these (which is A.e- ,nva)i ' sin (nira); and then add these individ- 
ual responses to get the solution corresponding to the IC «(x, 0) = <j>(x). . 

3. The terms in the solution 

u{x,t) = sin (nx) + sin (2 ttx) + . . . 

are functions of x and t. Note that the terms further out in the series get 
small very fast due to the factor 


Hence, for long time periods, the solution is approximately equal to the 
first term 
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ir(.v.f) e A,e *">■ sin (m) 

which is the shape of a damped sine curve (Figure 5,5). 



FIGURE 5.5 Higher-order terms damp faster in diffusion problems. 


PROBLEMS 



1. Show that «(x,f) = e~ xV, '[A sin (kx) + B cos (Xx)] satisfies the PDE u, 


- a for arbitrary A, B, and k. 


2: Show 


£ 


sin (■nmx) sin (nnx) dx 


HINT- Use the identity 



sin (nix) sin (nx) = -[c 


3. Find the Fourier sine expansion of <d(x) =1 0«r« 1. Draw the first 

three or four terms. 

4. Using the results of problem 3, what is the solution to the 1BVP 

PDE u, = u„ 0 < x < 1 


BCs 


| u(0.t) = 0 

1 «( 1.0 = 0 


0 < r < * 


1C m(a.O) = 1 <> st x =s 1 
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(Note that this problem is physically impossible, since we are pulling the 
temperature from one to zero instantaneously. In most problems, if the BCs 
are zero, then the initial temperature 4>(*) should also be zero at * = 0 and 

5. What is the solution to problem 4 if the IC is changed to 

w(at,0) = sin (2-iTAr) + | sin (4irjr) + | sin (6iw) 

6. What would be the solution to problem 4 if the IC were 

“(*.0) = x - x 2 0 < jc < l 


OTHER READING 

Partial Different Equations of Mathematical Physics by Tyn Myint-U. Elsevier 1973 A 
well-written text slightly more advanced than the current one; Chapter 6. A large chapter 
on separation of variables with several good problems. 
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LESSON 6 

Transforming Nonhomogeneous 
BCs into Homogeneous Ones 



Although the method of separation of variables that we discussed in the last 
lesson is very powerful and gives us a nice series solution, the reader should 
realize it doesn’t apply to all problems. In order for separation of variables to 
apply, the BCs must be of the following form ( linear homogeneous BCs): 

(6.1) «|M,(0./) + p,«(0.r) = 0 

a 2 u,(L,r) + p 2 u(L.r) = t) 

The purpose of this lesson is to show how problems with nonhomogeneous BC 
like 
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PDE 


(6.2) BCs 
IC 


[«,»,(()./) - P,M«U) = £,(/) 
|a : rr,(L.rl * (Tira.r) = j ?,(m 

rrf.v.O) = 6(.v) 


(non homogeneous BCs) 


can be soi\eu in transforming them into others with zero BCs. The new problem 
can then be solved by other methods (like eigenfunction expansions). We start 
our discussion by transforming an extremely simple problem with nonhomo- 
geneous BCs into one with zero BCs. 


Transforming Nonhomogeneous BCs to Homogeneous 
Ones 

Consider heat flow in an insulated rod where the two ends are-kept-at constant 
temperatures A - , and k : ; that is. 

PDE u, = ora,’ 0 < jt < L 0 < / < * 


1C u(.v.O) = 4>M 0 « a- =s L 

The difficulty here is that since the BCs are not homogeneous, we cannot solve 
this problem by separation of variables. However, it is obvious that the solution 
will have a steady-state solution (solution when t = *) that varies linearly (in 
x) between the boundary temperatures k, and k 2 (Figure 6.1). 



FIGURE 6.1 Solution of (6.3) for various values of time. 
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In other words, it seems reasonable to think of our temperature n(x.f) as the 
sum of two parts 

u(x.t) = steady state + transient 


Eventual solution Part of the solution that 

for large time depends on the 1C (and 

will go to zero) 

= [*, + j- (k : - k,)] + U(x.i) 

This being the case, our goal is to find the transient U(x.t). By substituting 


u(x,t) = [it, + ~ (k 2 - fc,)] + U(x.t) 

in the original problem (6.3). we will arrive at a new problem in U(x,t). We can 
then solve this new one for U(x,t) and add it to the steady state to get u(x.f). 
Carrying out this simple substitution in (6.3) gives us 

PDE U, = <x 3 U„ 0 < x < L 


- teu°o — 


IC l/(*,0) = 6(A) - [*, + ~(k 2 - k,)} 

6 (a) = new IC — but known 

.This problem (fortunately) has a homogeneous PDE as well as homogeneous 
BCs. and so we can solve it by separation of variables: in fact, the reader 
probably remembers the solution: 

(6.5) U(x,t) = 2) a « e ’ sin ( nvx/L ) 

where 

a„ = 1 1 6(0 sin {ntti/L) di 

So much for rods with fixed temperatures at the boundaries. What about 
more realistic-type derivative BCs with time-varying right-hand sides? The ideas 
are similar to the previous problem but a little more complicated. 
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PDE U, = a *U XX - S, (nonhomogeneous PDE) 

(6.10) BCs {y(o',f=V y(U) = ° (homogeneous BCs) 

IC f/(x,0) = 4>(x) - 5(x,0) (new IC — but known) 

We now have our new problem with zero BCs (unfortunately, the PDE is 
nonhomogeneous). We can’t solve this problem by separation of variables, but 
if the reader can wait for a few lessons, we will solve it by integral transforms 
and eigenfunction expansions. 

NOTES 

1. Our goal in this lesson was to transform problems with nonhomogeneous 
BCs into those with zero BCs. In so doing, if the new PDE just happens 
to be homogeneous, we are fortunate (like the first example) because we 
can then solve the problem by separation of variables. 

If, on the other hand, the new transformed PDE is nonhomogeneous, 
then we must solve the new problem by some other method. 

2. The most general nonhomogeneous linear BCs 

a,!*, (0,/) + P,«(0,0 = g,(r) 
a : u x (L.0 + MM = ft( 0 . 

can also be transformed into zero BCs in a manner similar to the technique 
in the second example. Of course, the new PDE would most likely be 
nonhomogeneous. 

3. Some methods of solution do not require the BCs to be homogeneous at 

all, and, hence, it isn’t necessary to make any preliminary transformation. 
Later, when we study the Laplace transform, we will see it isn’t necessary 
to have zero BCs (it’s just that it’s sometimes easier). 

4. For BCs of the form 

“(0,0 = g,( 0 

«(M = g 2 (t) 

the method discussed in the second example will give us the transformation 
u(x.t) = {g,(0 + j-(g 2 (r) ~ g,(0]} + U(x,t) 

PROBLEMS 

1. Solve the initial-boundary-value problem 
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OTHER READING 

Analysis and Solution of Partial Differentia! Equations by R. L. Street. Brooks-Cole, 
1973. This excellent text contains an extensive section on transforms of the type we 
discuss in this lesson and a good section on separation of variables. 
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LESSON 7 



Solving More Complicated 
Problems' by Separation of 
Variables 


PURPOSE OF LESSON: To show how more complicated heat-flow 
problems can be solved by separation of variables. This lesson essentially 
consists of a worked problem that will giv e the reader more familiarity 
with the method. Hopefully, the reader will be able to extrapolate the 
ideas presented here to soive problems on his or her own. 

Eigenvalue problems, known as Sturm- Liouville problems, are intro- 
duced, and some properties of these general problems are discussed. 


The purpose of this lesson is to solve an initial-boundary-value problem by the 
separation of variables method, that the reader might have trouble working on 
his or her own. Hopefully, the reader can extrapolate from this problem to other 
problems not specifically mentioned in this text. 

We start with a one-dimensional heat-flow' problem where one of the BCs 
contains derivatives. 

Heat-Flow Problem with Derivative BC 

Consider an apparatus 



FIGURE 7.1 Diagram for the initial-boundary-value problem. 
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in which we fix the temperature at the top of the rod at u(0./) = 0 and immerse 
the bottom of the rod in a solution of water fixed at the same temperature of 
zero (zero refers to some reference temperature). The natural flow of heat 
(Newton’s law of cooling) says that the BC at x = 1 is 


u x (l,r) = -}m (l,r) 



Suppose now the initial temperature of the rod is u(*,0) = *, but instantaneously 
thereafter (t > 0), we apply our BCs. To find the ensuing temperature, we must 
solve the IB VP 

PDE u, = a. l u xx 0 < x < 1 0<f<oo 

(7.1) BCs {u/oJ +°h u (i >f ) = o (homogeneous BCs) 

"IC u (x,0)' = x fnt'x «5'1 " ' 

To apply the separation of variables method, we carry out the following steps: 

STEP 1 (Separating the PDE into two ODEs) 

Substituting u{x, t) = X(x)7’(f) into the PDE gives 

XT = «TT • 

and dividing by of XT. we get 

T_ _ £ 
a-T X 
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Since the left-hand side depends only on time and the right-hand side depends 
only on x (and since x and t are independent), both sides of this equation must 
be constants. Setting them both equal to p gives the two ODEs 

(7.2) T ~ pa* 7 = 0 

X' - pX = 0 

We have now completed the separation process. 

STEP 2 (Finding the separation constant) 

First of all, p must not be positive or else T(r) will grow exponentially to infinity 
(which would make u - XT go to infinity— which we can reject on physical 
grounds). 

Secondly, suppose p = 0. This being the case, we have 


and thus 

X(x) = A + Bx 

But since the BCs of the problem are 

u (0, r) = X (0)T(t) = 0 

u, (l,t) + hu (1,/) = X'( 1)7(0 + hX([) T(t) = 0 

we could conclude that 


*( 0 ) =0 / 1=0 
X’ (1) + hX( 1) = 0 ^ B = 0 

which would (nean u(x,t) = 0. In other words, p = 0 gives only a = 0; hence 
we throw it out (we are looking for nonzero solutions). 

Finally, if p < 0, we call p = -.V : and write the two ODEs (7.2) as 

T + \-VT = 0 
A* + \-X = 0 


which gives us solutions 

Tit) = Ac 

A'(.v) = B sin (.U) + C cos (At ) 
Hence, what we have is that any function 
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u[x. t) - e [A sin ( kx) - B cos (\j*t)) 


for any \ ;ind any A and B will satisfy the PDE (the reader can verify this 
calculation on his or her own). What we'd like to do now is find out how many 
of these functions will satisfy the BCs 



Substituting the solution (7.3) into the BCs (7.4 1 gives us conditions on X, A. 
and B that must be satisfied: namely. 

Be = ()=i> b = o 

i4Xf" ,k “''' cos X + hAe~'^‘ sin X = 0 

Performing a little algebra on this last equation gives .us our. desired condition 
on X 

tan X = - \lh 

In other words, to find X. we must find the intersections of the curves tan X and 
- kill (Figure 7.3). 



FIGURE 7.3 Graph showing intersections of tan (X) and -k/h. 

These values X,. X : . . . . can be computed numerically for a given A on a computer 
and are called the eigenvalues of the boundary-value problem 

' A"’ + \ 2 X = 0 

(7.5) A' (0) = 0 

A"(l ) + hX (!) = 0 
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In other words, they are the values of X for which there exists a nonzero solution. 
The eigenvalues X„ of (7.5), which, in this case, are the roots of tan X = 
-k/h. have been computed (for h = 1) numerically, and the first five values 
are listed in Table 7.1. 


TABLE 7.1 Roots of 

tan x = - X 


2.02 
4.91 
7.98 
1 1.08 ’ 
14.20 


The solutions of (7.5) corresponding to the eigenvalues X„ are called the 
eigenfunctions X„{x). and for this problem, we have 

X„(X) = sin (X, r v) 

See Figure 7.4. 



FIGURE 7.4 Eigenfunctions X n [x) of (7.5) for h = 1. 

STEP 3 (Finding the fundamental solutions) 

We now have an infinite number of functions (fundamental solutions). 

u„ (x, t) = X„ (a) TJt) = e sin (X*a) 

each one satisfying the PDE and the BCs. The final step is to add these functions 
together (the sum will still satisfy the PDE and BCs. since both the PDE and BCs 
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are linear and homogeneous) in such a way that they agree with the IC when i 

t - 0; that is; we sum f 1 . . j 

u{x,i)= ia/,WT,(i) * r , c . ,, \ )fe I 


X TABLE 7.2 Coefficients 

( fo, (W\ w )£ - Cy> (X a n in (7.8) 




so that the IC w(x,0) = x is satisfied. In other words. 


S a n e-^ a)1 ' sin (X„x) _ _J_ [ \ — ! Si •*(>* -V*)! 4 

r ^SmVw.A\v, 

fied. In other words, -- i- I r w rc~ J , , 

X L V~v Hence, the first three terms of the IB VP 


u(x, 0) = x = *2, a „ sin (X„.t) 


= -tow \a ~ - PDE u, = u„ 0 < jc < 1 0 < f < 5 

l f S.*V.Ay.-»-t- S,-nV>,c.A^ - X 1 

/ Si'wVnC»^>*t + S.vV^ X, ^7 a\ RCs I u (0 ,i) = ,0 > Q <f<x 

~ ( ^ v ^ 7 r! ■F ) - o 


This brings us to our final step. 


STEP 4 (Expansion of the IC as a sum of eigenfunctions) = w- JL 

To find the constants a„ in the eigenfunction expansion (7.6), we must multiply 2- 
each side of the equation by sin (X„x) and integrate x from ttto 1; that is; 

l 5 sin (X m 0 d£ - 2 a„ jf sin (X„£) sin (\,„£) d£ 

= a m jf sin 2 (X m $) d£ 


Solving for a m (we’ll change the notation" to a]), we get our desired result 


^VkC,Vi,c]- oM (x,0) = 


" (X„ - sin X„ cos X„) 

In other words, our solution to (7.1) is 


l ? sin (X„$) d£ 


where the constants a„ are given by (7.7). In this problem, the first five constants 
a„ have been computed and are listed in Table 7.2. 


u(x , t) = 0.24 e~ M sin (2x) + 0.22 e' 24 ' sin (4.9x) 

+ 0-03e- M - 3 'sin (7.98x) + . . . 

The graph of this solution is drawn for various values of time in Figure 7.5. The 
reader can ask himself or herself if this solution agrees with his or her intuition 
and whether or not it satisfies the BCs of the problem. 



FIGURE 7.5 Solution to (7.8). 


The eigenvalue problem (7.5) is a special case of the general probler 
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ODE \]Hx) y'J' - q(x)y - X r(x)v = 0 (I < * < 1 

.(7.10) 

BCs 

known as the Sturin-Liouviiie problem. When we solve PDEs by separation of 
variables with linear homogeneous BCs. the. ODE in A’(.v) along with its BCs 
will always be some particular Sturm-Liouville problem. We observe that the 
eigenvalue problem (7.5) is a special case of (7.10). 

What Sturm and Liouville proved is that under suitable conditions on the 
functions p(.v). q(x). and r(A). the problem (7.10) has 

1. An infinite sequence of eigenvalues 

X, < < X. ; < . . . < K„ x 

2. Corresponding to each eigenvalue X„. there is one nonzero solution 
y„ (a) [not including other constant multiples of .y„(x)]. 

3. If y„(x) and y m (x) are two different eigenfunctions (corresponding to X„ 
t X m ) . then they are orthogonal with respect to the weight function r(x) 
on the interval of [0.1]; that is. they satisfy 

l r(x) y„(x) yjx) dx = 0 

More details of Sturm-Liouville-type problems can be found in references 1 
and 2. 


kv (0) + (3,y'(0) = 0 
1«’V(1) + p,v'(l) = 0 



i, 

I 


ir 

$ 


i 
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ODE 


XA' = 


BCs 


A"' + 

Ar(0) = 0 
A"(l) = 0 


What are the functions p(x ). q(x). and r(.v) in the general Sturm-Liouville 
problem for this equation? 

3. Solve the following problem with insulated boundaries. 

PDE u, = u, x 0 < a < 1 0 < t < * 


BCs 


k(o.f) = o 
1«,(U) = o 


IC. : . . u(x,0) — x 0 « .V si 

Does your solution agree with your interpretation of the problem? What is 
the steady-state solution?; does this make sense? 

4. What are the eigenvalues and eigenfunctions of 

ODE X" + KX m 0 0 < a < 1 


BCs 


(A"(0) = 0 
\X' (1) = 0 


OTHER READING 

1. Elementary Differential Equations and Boundary-Value Problems by W. E. Boyce 
and R. C. DiPrima. John Wiley & Sons, 1965. Chapter 11. This is an ordinarv-differential- 
eqtr-tions text that contains an excellent section on the Sturm-Liouville problem, one of 
the better undergraduate texts in ODEs. 

2. Advanced Engineering Mathematics by E. Krevszig. John Wiley & Sons. 1967. This 
text contains many worked examples of typical problems: very readable. 
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LESSON 8 

Transforming Hard Equations into 
Easier Ones 


PURPOSE OF LESSON: To show how one can transform a PDE in 
u(x,t) into a new (easier) one in a new variable w(jr,/). The transformation 
is generally based on intuition, and in this lesson, the PDEs 

u, = a 2 u, x - p u 
u, = a 2 u xx - vu x 

are transformed into the simple heat equation 


by means of the transformations 

u(x,t) = e-*‘w(x,t) 
u(x,t) = e' ,lx ~ rU2V2a,2 w(x,t) 

After the transformations are made, the heat equation (the easy one) can 
be solved for w(jr ,t), hence, 

u = e' 8 'tv(jr,/) 

u = e ** “ ,i,J l /J “*’vv(i;/)' 

are the solutions of the original equations (of course, the BCs and the IC 
must be transformed too). 


The reader may get the impression from the last two lessons that the only type 
of PDE that can be solved by separation of variables is 


It is true the heat equation is the easiest parabolic PDE to solve by separation 
of variables, but it is in no way the only equation we can solve by this technique. 
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As mentioned earlier, as long as the equation is linear and homogeneous, we 
can separate variables. For example, two-dimensional heat flow inside a circle 
would be described by the equation 



and although it has variable coefficients, it can still be separated into three ODEs. 

This lesson will show the reader that sometimes a PDE doesn’t have to be 
attacked directly but that the original PDE can be transformed into an easier 
one. In this way, the easier problem can be solved (by separation of variables 
or some other technique). We now present an example that illustrates this 
technique. 

Transforming a Heat-Flow Problem with Lateral Heat 
Loss into an Insulated Problem 

Consider the following problem: 

PDE u, = a 2 u„ - Pu 0 < x < 1 0 < r < =° 

< 8 » BCs {a(U) = l 0<,< * 

IC . «(x,0) = <j>(x) Os-rsu 

where the term - p u represents heat flow across the lateral boundary (Figure 

8 . 1 ). 



FIGURE 8.1 Heat flow described by u, = a 2 u„ - pu. 


The goal of this lesson is to introduce a new temperature w(x,t) in place of 
u(x,t), so that the PDE in w is simpler than the original one 

It. = iX-U., - pu 

This is a common technique in PDEs. and the transformation is generally based 
on an intuitive feeling of how the solution of the original PDE behaves. For 
example, in our problem (8.1), the temperature u(x.i) at any point ,r„ is changing 
as a result of two phenomena 
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1. diffusion of heat within the rod (due to err/,,). 

2, heat flow across the lateral boundary (due to 

The important point is that if there were no diffusion within the rod (a = 0). 
then the temperature at each point .v., would “damp" exponentially to zero 
according to 

m(.v. .. / 1 = t((.v„.0)f" B ' 

By means of this observation, we wonder if we can essentially decompose the 
temperature u(x,i) of problem (8.1) into two factors 

(8.2) u(x,r) = c~ a 'w(x,t) 

or 


Noninsulated temperature = e” 6 .'. - (insulated temperature) 

where w(x.l) would represent the temperature due to diffusion only. Let’s see 
what happens if we substitute this expression into problem (8.1); this is a routine 
calculation (the reader can do it on his or her own), and we arrive at 

PDE ic, = ct 2 w A , 0 < x < 1 0 < f < « 


IC H'(x,0) = <K*) 0«JT<1 


This is exactly the same problem we started with except that now the PDE 
doesn't contain - Bu; so all we have to do to solve (8.1) is solve the transformed 
problem (8.3) and then multiply the solution w(x,t) by e‘ B '. In this case, we have 
already solved (8.3) previously by the separation of variables method and found 



and. hence, the solution of the original problem (8.1) is 

u(x,t) = e- B 'ic(x,r) 

The following example in the notes is solved bv this technique. 
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In this case, the transformation is 

u(x,t) = w(x.t) 

This transformation essentially factors out the part of the solution (expo- 
nential factor) that is due to the moving medium. Note that the exponential 
factor consists of a moving exponential (moving to the right with velocity 
v/2). The reader will get a chance to use this transformation in the problem 
set. 


PROBLEMS 

1. Solve the diffusion problem 
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PDE 


0 < x < 1 0 < t < 


by transforming it into an easier problem. What does the solution look like? 
We could interpret this problem as describing the concentration u(x,t) in a 
moving medium (moving from left to right with velocity v = 1) where the 
concentration at the ends of the medium are kept at zero (by some filtering 
device) and the initial concentration is e* a . Does your solution agree with 
this interpretation? 

2. Solve the problem 


0 < jc < 1 0<t<3 


IC ■ u(jc,0)-= 0 0 jc 1 


(a) changing the nonhomogeneous BCs to homogeneous ones. 

(b) transforming into a new equation without the term -u. 

(c) solving the resulting problem. 

3. Solve 


: BCs-' 

IC w(jc,0) = sin (it*) 0 « x *£ 1 

directly by separation of variables without making any preliminary trans- 
formation. Does your solution agree with the solution you would obtain if 
the transformation 

u(x.t) = er'w(x,t) 


were made in advance? 
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OTHER READING 

Nonlinear Partial Differential Equations in Engineering by W. F. Ames. Academic Press, 
1965. This text discusses many types of transformations for changing old problems into 
new ones, so that sometimes even nonlinear problems can be transformed into linear 
ones. 
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LESSON 9 

Solving Nonhomogeneous PDEs 
(Eigenfunction Expansions) 



In Lesson 6. we discussed how transformations could be made to transform 
nonhomogeneous BCs into homogeneous ones. Unfortunately, the PDE was left 
nonhomogeneous by this process, and we were left with the problem 
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PDE 


//, = cr«„ + fi.x.i) (f < a < 1 U < , < a 
+ P,«(0.0 = 0 0< , <x 

h(a,0) = 6(a) 0 sis! 

The purpose of this lesson is to solve this problem by a method that is analogous 
to the method of variation of parameters in ODEs and is known as the eigen- 
function expansion method. jfey-jC 

The idea is quite simple. Inasmuch as the solution of (9.1) with f(x.t) = 0 
(so-called corresponding homogeneous problem) is given by 

u(x,t) = “ne~ M, 'X„{ a) 

where X„ and X.(x) are the eigenvalues and eigenfunctions of the Sturm-Liouville 
problem, 

X" + \ 2 X ** 0 

(9.2) 0,^(0) + P,AT(0) = 0 

a 2 r(l) + (3 : *(1) = 0 

we ask whether the solution of the nonhomogeneous problem (9.1) can be 
written in the slightly more general form 

u(x,t) = f T r (t)X„(x) 

The reason for this speculation is physically appealing, inasmuch as a source of 
heat /(a,/) within the rod will give rise to a new time component and not the 
damping factor 


as was the case when the only input into the problem was the IC. 

To show how this method works, we apply it to a simple problem so the 
details aren’t as complicated. 


Solution by the Eigenfunction Expansion Method 

Consider the nonhomogeneous problem 


(9.1) BCs 
iC 
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PDE u, = ot*M„ + /(*,/) 0 < .t < 1 0 < r < * 

(«> BCs {S!-2. 0<,< “ 

1C u(.r,0) = 4>(.v) 0*jr<l 

To solve this problem, we divide the procedure into the following steps: 

STEP 1 The basic idea in this method is to decompose the heat source f(x,t) 
into simple components 

" /(*.o = /,(')*, w + mx 2 ( X ) + ... + f n ( t )x„(x) + . . . 

and find the response u„(x,t) to each of these individual components f„(t)XJx). 
The solution to our problem is then 

u(x,t) = 2 “n(x,t) 

To determine how to decompose /(*,/) into its component parts f„(t)XJx) is one 
of the major problems. It turns out that the *,,(*) factors in this problem are 
the eigenvectors of the Sturm-Liouville system we get when solving the associated 
homogeneous problem to (9.3) by separation of variables; that is, 

u, = a 2 u„ (note that f(x,t) = 0) 

(9.4) u(0,t) = 0 

u(l,t) = 0 
u(x, 0) = <|)(;c) 

in this case, the Sturm-Liouville problem we find when separating variables is 


x' + \ 2 x -'o 

*(0) = 0 
X(l) = 0 

and, hence, the X„(x) are 

yV„(.r) = sin (rnr.x) n - 1,2,... 

Hence, our decomposition of the heat source has the form 

(9.5) fix a) = /,(/) sin (7TX) + /,(/) sin (2-rr.v) + . . . + /Jr) sin (nirx) + . . . 

Finally, to find the functions /„(/), we merely multiply each side of this 
equation by sin ( rmrx ) and integrate from zero to one (with respect to .t); 
hence, we have 
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f(x,t ) sin (mnx) dx = 'Zf n (t) j[ sin (mitx) sin (/nrx) dx 
or (changing m to n) 

(9.6) f„(t) = 2 jf f(x,t) sin (mrx) dx 

This will give us an equation for the coefficients fjt) in terms of the heat 
source fix A). 

STEP 2 (Find the response ujx,t) = TJt)XJx) to input fJt)XJx)) 

We now replace the heat source fix a) by its decomposition 

fix A) = S /„(0 sin {n-nx) 

and try to find the individual responses 

u(x,t) - X T »(‘) sin ( rt ™0 

in other words, we seek the functions T n (r). Knowing these, the answer to our 
problem is 

u{x,t) = 2 Tnif) sin (nxrx) 

Substituting u(x,t) = 2 T’nW sin (max) into the system 

it, = a 2 u tx + X sin (mrx) 

«(()./) = 0 
i/(l. r) = 0 
//(.v.O) = Mx) 

gives us 
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X T'jr, sin («T.vl = -or X (nw) 2 7’„(7) sin (mrx) f X /»(') sin (/im) 
X T„(t) sin 0 = 0 (says nothing; zero = zero) 

(9.7) 

X 7, (M sin (nr! = (i • (says nothing: zero = zero) 

X T„( 0 ) sin (nm.) = d>(ji:) 

Rewriting the PDE and the IC as 

PDE T 1 7",’, + (mra) : r„ - f„(t )] sin (mrx) - 0 
1C X T*(0) sin (nmr)- = 4 >(x) - 

we can see fairly easily that T„(t) will satisfy the simple initial value problem 

( 9 . 8 ) T' n + (mra) 2 T n = f n (t) 

r„(0) = 2 J[ 4>(€) sin (nr|)^ = a„ 

This ODE is one of the easier ones to solve (use an integrating factor) and has 
the solution 1 .iiX: 

(9.9) T„(t) = f n (j) <h 

Hence, the solution of problem (9.3) is 

(9.10) u(x.r) = X T.U) sin (nr x) 



Transient part Steady state 

(because of the initial condition) (because of the right-hand side f(x,t)) 

We can see from this solution that the temperature response is due to two parts. 
the first part that is due to the IC and the second part that is due to the heat 
source f(x.t). The phrase steady state is not the best phrase to describe the 
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second part, since it doesn't necessarily come to rest (it may approach a periodic 
steady state, if f(x.t) is periodic in /), 

This completes the problem. Before stopping, however, we will show how 
this method can be applied to a specific example. 


Solution of a Problem by the Eigenfunction-Expansion 
method 

Consider the simple problem 

PDE u, = a : u xx + sin (3m-) 0 < x < 1 


IC u(x, 0) = sin (mr) 0 s r s 1 

Our goal is to compute the coefficients T„(t) in the expansion 

u(x,t) = X T„(t) sin (mrx) 


(the eigenfunctions X n (x) are still the same for this 7 problem). If we substitute 
this expansion in the problem, we will get an ODE for the functipns T„(t) 
In fact, we will get 

T'„ + (mra) 2 T„ = /„(f ) =2^ sin (3m:) sin (mrx) dx = 

T -(°) = 2 j[ sin (Tri) sin (mt£) = j* “ j 

Writing out these equations for n = 1.2 we see 


(« = 1 ) 

T\ + (iraY-T, 
U 0 ) = 1 

°}=> T,(t) = 


(« = 2 ) 

T? + (27ra)-T, 
T 2 ( 0) = 0 

= °}=» m = 0 


(/! = 3 ) 

T 5 + (3™)-T 3 

= T(A = 1 



r 3 ( 0 ) = 0 

1 3 (3ira) : 

[1 “ 

(n ^ 4) 

T'„ + (mra) 2 T„ 
U 0 ) = 0 

= °jU T.(t) = 0 
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Hence the solution of our problem i< 


Transient 

(because of initial conditions) 


Steady state 

(because of the right-hand side of the PDE) 


1. The method of eigenfunction expansion is one of the most powerful for 
V ' n n n0n , 0m ° gene0US P l DEs - ^ r - when we «udy integral transforms . 

, J^!l£l^L ther t are other ^g th^s for solving these types of 'pro blem^. 

- S in the ex P ansion change from profclo pTSbl^ 

and depend on the PDE and BCs. The reader should look at problem 4 in 
the problem set to make sure he or she knows how to find the eigenfunctions 

1 If the reader remembers ODE theory, he or she will remember that solutions 
ot equations corresponding to nonhomogeneous terms like 


he^ Problemf^/n "i!? of “ ndetermined coefficients. The same is true 
^ - (9-11 could be solved by this method. Any reader interested 

tn this method should consult the reference. 


1. The solution of the problem 


i (3irx) 0 < x < 1 


BCs {:<u!:S »<'<* 

IC u(x,0) = sin (itx) 0 .r =s 1 

tokiikeT ‘ hiS S0 '“ ,iOn aSr " y °" r inn,i ' ion, Wta d ““ 
Solve the problem 


- sin (ttx) + sin (2-jtjc) 0 < x < 1 0 < r < a 
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BCs l u (0’0 ~ 0 
ju(l,r) = 0 


u(x,0) = 0 0 =s A 


3. Solve the problem 


n (ttx) 0 < x < 1 0 < / < a 


by the method of eigenfunction expansion. 
Find the solution of 


= «« + sin (X,x) 0 < x < 1 0 < r < a 


Kd,0 + «(!,/) = 0 0<t< * 

IC u(x,0) = 0 0 5 ; x 1 

by the method of eigenfunction expansion where is the first root of the 
equation tan X = -X. What are the eigenfunctions ,Y„(x) in this problem'* 
5. Solve the problem 


| «(0,r) = 0 
(_ «(!,/) = cos t 


(a) transforming it to one with zero BCs. 

(b) solving the resulting problem by expanding it in terms of eigenfunc- 
tions. 


OTHER READING 

Elementary Partial Differential Equations by P. W. Berg and J. L. McGregor. Holden- 
ay. 1966. One of the more popular texts on PDEs: slightly more advanced than this 
text; clearly written. An extensive section on nonhomogeneous problems (Chapter 5). 
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LESSON 

Integral Transforms (Sine and 
Cosine Transforms) 


PURPOSE OF LESSON: To introduce the idea of integral transforms 
and show how they transform PDEs in n variables into differential equa- 
tions in n - 1 variables. 

It is also shown that these transforms can be interpreted.^ resolving 
the input of the problem into simple. parts (.frequency resoKrtton), finding 
the solution for each subpart, and adding the results. 

In summary, integral transforms change differentiation to multiplication, 
and, hence, certain partial derivatives are changed into algebraic expres- 
sions. ' 

The sine and cosine transforms are introduced and are used to solve an 
infinite-diffusion problem . The solution is interesting in that it involves the 
complementary-error function . 


An integral transformation is merely a transformation that assigns to one function 
f(t) a 'sew function F(s) by means of a formula like 

F(s) = l K(s,t)f(t) dt 

Note that we start with a function of i and end with a function of s. The function 
K(s.t) is called the Kernel of the transformation and is the major ingredient that 
distinguishes one transform from another: it is chosen so that the transform has 
certain desirable properties. The limits of integration A and B also change from 
transformation to transformation. 

Th e general philosophy behind integral transfo rma tions is that they eliminate 
p artiaT derivatives with respe ct to one of the variablesThence. the new equation 
"has one less variable. For example, if we apply a transform to the PDE. 


for the purpose of eliminating the time derivative, then we would arrive at an 
ODE in x. On the other hand, if we had the PDE 
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the derivative andwSdh^a POE* W0 “ ld elimina ' e 

general strategy is illustrated in Figure 10 . 1 . h °™“ la problem > h| s 



FIGURE 10.1 General philosophy of transforms. 


' n t®? r al transform, there is an 
The transform and its inverse together f ngm ,f functlon fr °m its transform. 
Table 10.1 lists several commo^tHmsformp^r^llfat we wilfuseTo scdvePDEs. 


TABLE 10.1 Some Common Transform Pairs 


Transform pairs * " " ” ' ■ 

1 ~ = v 1 M s,n M dt (Fourier sine transform) 

\F\ = /(/) = | F(ta) sin (tor) du> (inveise sine transform) 
F(u>) = v [ f(t) cos (tat) dt (Fourier cosine transform) 

U (FI - fit) = | F(ta) cos (u>t) dto (inverse cosine transform) 


^ V2tt e ~““ dx (Fourier transform) 

^ ^ V2v e ““ dw (inverse Fourier transform) 
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Note that in these transforms we have alternative notations. For instance, in 
the case of the Laplace transform, the notation X \f\ indicates that we are taking 
the transform of /, whereas the alternative notation F(s) indicates a function 
of s. 

The current lesson does not attempt to study all of these transform pairs— 
only the sine and cosine transforms (1. and 2.); later, we will study several of 
the others. Questions about the relationship between the transforms, when to 
apply them, advantages and disadvantages of each, will be answered as we go 
along. However, before we begin the study of integral transforms; it will be 
useful to study what is called the spectrum of a function (or the spectral resolution 
of a function). 

The Spectrum of a Function 

Integral transforms and the spectrum of a function are closely related; in fact, 
an integral transformation can be thought of as a resolution of a function into 
a certain spectrum of components. How the transform actually resolves the 
function changes from transform to transform, but the function is being resolved 
into something nevertheless. 

For instance, let’s consider the resolution of a periodic funciton f(x) into sines 
and cosines (Fourier series)* 

* Fourier series will be discussed in detail in Chapter 11. 


74 Diffusion-Type Problems 


(Figure 10.2). 


J\x) = 2 [4, cos ( nx ) + 3„ sin (rut)] 



FIGURE 10.2 Expansion of a periodic function into sines and cosines. 

Here, the coefficients A„ and B„ represent the amount of the function /(x) made 
up by cos (nx) and sin (nx), respectively, while the square root 

VAJ + B\ 

(called the spectrum of the function) measures the amount of /(x) with 
frequency n. 

For example, if the function /(x) were a simple sum of sines and cosines 
f(x) = 1 + sin x + ^ sin (3x) + cos x + ^ cos (2x) + ^ cos (4x) 
then its spectrum (discrete) would be as given in Figure 10.3. 



FIGURE 10.3 Discrete spectrum of f(x). 

By reading off the values of + B 2 n , we can tell the magnitude of the 

component in/fx) with frequency n. 
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Functions that are periodic can be resolved into infinite series (they have 
•^discrete spectrums). whereas functions that are not periodic must be resolved 
into a continuous spectrum of values (of course, if a function is defined only on 
a finite interval, we could extend the function outside the interval in a periodic 
way, so that a Fourier scries representation could be obtained for the function 
inside the interval). 

For example, although a nonperiodic function /(a) cannot be represented by 
ar, infinite scries of sines and cosines, we might be tempted to write it as a 
continuous analog of the Fourier series; that is, 

f{x) - j JC(w) cos (uu) + S(u>) sin (u>a)] dto 


where the functions S( to) and C(u>) measure the sine and cosine component of 
fix) and 


measures the w frequency component of f(x) and is called the spectrum (contin- 
uous spectrum) of /(a). 

With this intuitive explanation of the spectrum of a function, we now get to 
the nuts and bolts of integral transforms. The first step would be to list a few 
properties of these transforms that make them work. 


Sine and Cosine Transforms of Derivatives 

1. & s \f‘] = | (proved by integration by parts) 

no.n 2 w = ■ 

3. sun =”-/(0) + u>^ \f\ 


4. = -In 0) - uFsg/i 


Several other sine and cosine transforms and their inverses can be found in the 
tables at the end of the lessons. We now show how the sine transform can solve 
an important initial-boundary-value problem. 


Solution of an Infinite-Diffusion Problem via the Sine 
Transform 

The problem we are interested in is the infinite diffusion problem 
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(Figure 10.4). 


PDF u. = (I < .v < * 

BC t/((). t) - A (I < t < y. 
JC u (x. 0) = 0 0 =s .v < * 


I 


,V<Jr.O)*0 

FIGURE 10.4 Diffusion problem in a semi-infinite medium. 

STEP 1 -To solve this, weijr^ak it into three simple steps. First our strategy is 
to transform the x-variabffvi. a the Fourier sine transform so that we get an ODE 
in time. We start by transforming each side of the PDE; in other words 

9JLu, ) = cFSywJ 

Let’s consider each term individually: 

Th e P ar tial derivative u, in this problem is what we could.call the off 
derivative , since our transform is with respect to x. In this case, we can write 

&,[“'] ~ ~j «.( x 4) sin (wa) dx 



The fact that we took the derivative outside the integral is a property from 
calculus. Note that u is a function of a and t, whereas its transform 

= U(w,t) 


is a function of w and t. The new variable w will be treated like a parameter in 
the new problem, and, hence, we call the sine transform a function of t alone- 
that is. , ’ 



n*\ = m 


9,[u „ ]: For this one, we have the identity 

HuJ = - cou(0,/) - ur9,[u] 


Note here that when you proved these identities (10.1), you did it for functions 
of one variable f(x). We now have a slight modification, since u(x,t) depends 
on x and t. You should use the formulas according to which variable is being 
transformed and treat the others as constants. In this case, the transform is with 
respect to x, and, hence, I is just carried along as a constant. Also note that the 
BC u(0,t) = A is used at this point in our operation. 

Substituting these expressions into our PDE, we arrive at the ODE 


The only thing missing is an IC for t/(r); we get this by transforming the IC 
u (x,0) = 0 to get 

3;, [«(*,())] = t/(0) = 0 

This completes the first step in the transform process — we have changed the 
original problem into an initial-value problem 


STEP 2 To solve this I VP, we could use a variety of elementary techniques 
from ordinary differential equations (integrating factor, homogeneous and par- 
ticular solution); in any case, the solution is 


We have now found the sine transform for the answer u(x.t). The last step is 
to find the inverse transform of U(r); that is, 

u{x.t) = r? 7 '[U] 
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STEP 3 To find the solution, we can either evaluate the inverse transform 
directly from the integral or else resort to the tables. Using the tables, we 
see that 

u(x,t) = A erfc {xl2aVt) 

where erfc(x), 0 < x < =°, is called the complementary-error function and is 
given by 

T'-* 

See Figure 10.5 for its graph. 



FIGURE 10.5 Graphs of erf(x) and erfc(x). 


The exact values of these well-known functions can be found in most tables for 
physics and chemistry. It should be noted that these integrals cannot be inte- 
grated by the usual elementary tricks of calculus. 


Interpretation ot the Solution 

The solution _ 

u(x,t) = A erfc [xl2a\/~t\ 

makes a lotof sense. For different values of time, we have the graph of a 
complementary-error function with different scale factors on the .r-axis. As time 
increases, the error function gets pulled out; for a graph of the solution at 
different values of time, see Figure 10.6. 



FIGURE 10.6 Solution to semi-infinite rod with fixed temperature A at the end. 
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PROBLEMS 


1. Prove the identities (10.1). What assumptions do you need to assume about the 
function f? 

2. Solve the ordinary-differential equation problem (10.2). 

3. Solve by means of the sine or cosine transform 


PDE it, = « : m„ 0 •, x < r 

BC' «,((!. i J = 0 v < I < * 

1C m(a-,0) = H (1 - x) Osx<* 

where W(x) is the Heaviside function: 



In other words, the IC-looks like 



o 1 


What does the graph of the solution look like for various values of time? 


OTHER READING 

1. Operational Mathematics by R. V. Churchill. McGraw-Hill, 1958. An excellent text 
covering many of the integral transforms; good problems and many tables. 

2. Tables of Integral Transform by A. Erdelvi. McGraw-Hill, 1954. One of the most 
comprehensive tables of integral transform. 

3. Integral Transforms in Mathematical Physics by C. J. Tranter. Chapman and Hall 
(Science Paperbacks). 1971. A smali. but concise paperback; easy to read with many 
examples. 
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LESSON 11 


The Fourier Series and Transform 


PURPOSE OF LESSON: To introduce the Fourier series and to show 
how it can represent certain periodic functions f(x) bv sums of sines and 
cosines: ' 

/U ) = — + £ \a„ cos (mix) -r h„ sin (n-x)] 

In the case of nonperiodic functions on (-*. *). to show also how the 
Fourier series is replaced by the Fourier transform and how a function f(x) 
can be represented by a continuous resolution of simple functions. This 
resolution (the Fourier integral) can be written in the complex form 

= V5^ /- [vb di 

which gives rise to the Fourier and inverse Fourier transforms 
= ^y==^f ( x ) c -'0 dx (Fourier transform) 

= (inverse Fourier transform) 


The importance of the Fourier series in PDE theory is that periodic functions 
Ax) defined on ( - *. <*) or functions defined on finite intervals can be represented 
y infinite senes of sines and cosines, and in this way. problems can be resolved 
into simple ones. For example, the so-called sawtooth wave 


f(x) = x -L <x < L 

f(x + 2 L) = f{x) (periodic condition) 


shown in Figure 11.1 
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/■<*) 

I 



FIGURE 11.1 Sawtooth wave represented by a Fourier series, 
can be 


(11.1) 


where the Fourier coefficients a n and b„ are given by the Euler formulas 

(112) a " = I C0S ( nvxlL ) dx = 0 « - 0, 1, 2 

k>n= £ sin ( nirx/L ) dx = ~{2Llmt) (-1)" n = 1, 2, . . . 

These integrations are routine calculus evaluations. To find Euler’s formulas for 
ci n and b„, respectively, we multiply each . side of equation (11.1) by sin {nx) oi 
cos {nx) and integrate the resulting. equation from -LloL. The.orthogonalitx 
of the functions {sin ( ti-nx/L )} and {cos {n-nx/L)\ allows us to solve for the coef- 
ficients a„ and f>„; see problem 6. For the sawtooth wave, the Fourier represen- 
tation is given by 

(H.3) f(x) = J^sin (ttx/L) - ^ sin ( 2itx/L ) + | sin (3 itx/L) - . . . j 

where each term (called harmonic) has a larger frequency than the previom 
term, and all frequencies are multiples of a fundamental frequency that has thi 
same period as the function f{x) 

One of the drawbacks of the Fourier series is that in order for a function t< 
have a Fourier series representation, the function must be periodic. Of course 
if we want to expand a function (say ,/(.r) = .r for 0 =s .r =s 1) defined on a finite 
interval , we could use expansion (11.1). The fact that the Fourier series is periodic 
outside the interval [0,1] doesn’t concern us, since we're only interested in the 
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represented by the Fourier series 



function inside the interval. As a matter of fact, we can. represent a function 
inside an interval with many different types of Fourier series by considering 
different types of extensions outside the interval (some converge faster than 
others). 

The reader shouldn’t get the idea that every periodic function can be rep- 
resented by a Fourier series expansion. What we do know is that if a function 
f{x) can be represented by a Fourier series (11.1), then the coefficients a„ and 
b„ are given by the Euler formulas (11.2). What’s more, even if a function f{x) 
can be represented by a Fourier series, it isn't always true that the derivative 
f(x) can be found by differentiating the series term by term. In fact, we can 
easily see that the derivative of f(x) = x (the sawtooth function) cannot be found 
by differentiating each term of the Fourier series (11.3). Indeed, the differen- 
tiated series will not even converge for any x (the reader can verify this .himself 
or herself). 

The exact conditions that insure that a function f(x) will have a Fourier series 
representation and that the representation can be differentiated term by term 
are found in the recommended reading for this lesson. For our purposes, we are 
content to know the important result of P. G. Dirichlet’s (Deer-ish-lay) theorem, 
which states 


Dirichlet's theorem (sufficient conditions for a function to have a Fourier 
series representation): 

If f{x) is a bounded periodic function that contains a finite number of 
maximum points, minimum points, and points of discontinuity in each period, 
then the Fourier series of f(x) converges to f(x) at each point x where f(x) 
is continuous and to the average of the left- and right-hand limits of f{x) at 
those points where f{ x) is discontinuous. 


For example, in Figure 11.1, the Fourier series converges to the function f(x) 
for all except x = ±L, ±3 L, . . . (points of discontinuity), in which case it 
converges to zero (the average of + L and - L). 

We are now almost ready to introduce the Fourier transform. Before we do, 
however, it will be useful to introduce the idea of the frequency spectrum of a 
periodic function. 


Discrete Frequency Spectrum of a Periodic Function 

For periodic functions, we can interpret the Fourier series as the replacement 
of a periodic function f{x) by a sequence {c„} of numbers 
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where the numbers c„ can be taken as measuring the contributions of the various 
frequency components of the function f(x), For example, the sawtooth wave fix) 
has the Fourier series representation 

fix) = j^sin (it x/L) - q sin (2 tt x/L) + ^ sin (3iu:/L) - . . . j 

and, hence, the frequency spectrum {c„} is c„ = ZLin— for n = 1.2.... and 
c„ = = 0 (Figure 11.2). 



FIGURE 11.2 Discrete frequency spectrum of the sawtooth wave. 

The sequence {c„} is somewhat similar to the decomposition of white light into 
the frequency spectrum of colors obtained with a spectroscope. 

We now introduce the Fourier transform. 

The Fourier Transform 

The major difficulty with Fourier series representation is that nonperiodic func- 
tions defined on ( — =c.oc) cannot be represented. It is possible, however, to find 
an analogous representation for some of these functions. Without going through 
the details of the proof, we can show that the Fourier series representation 

f(x) = — + ^ \ a r cos (nit x/L) + b„ sin (nxt/L)] 

changes to the Fourier integral representation (continuous frequency resolution) 

(11.4) f(x) = J" a(£) cos i£x) di -t | b{Q sin (£r) d£ 
where 

a(€) = - f fix) cos (O') dx 

(11.5) 

b{%) = ~\ fix) sin (ex) dx 
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for nonperiodic functions defined on (-*,*). Here, we see that the Fourier 
integral representation has resolved the function f(x) into all frequencies 0 < 
= < “ , not J ust multiples of one basic frequency, as with periodic functions) 
As we did m the Fourier series, we define the frequency spectrum 

C(€) = VaW * b 2 (£) 


which measures the composition of the function /(a ) in terms of its frequencies. 
Some examples of functions f(x) and their frequency spectrums are given in 
Figure 11.3. 



FIGURE 11.3 Frequency spectra for various functions. 
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Note that functions /(x) that have sharp corners give rise to frequency spectr 
with large frequencies, since sharp corners require high-frequency componen. 
to represent them. On the other hand, the simple periodic function f(x) 
sm(^obvious.y has a frequency spectrum that is zero everywhere exce) 

We are now in a position to define what is generally known as the exponents 
Fourier transform (Equations 11.5 are known as the Fourier sine and cosin, 
transforms). By use of Euler’s (Oy-ler) equation 

e' 8 = cos 0 + / sin 8 

we can rewrite equation (11.4) after a little effort as 
(n - 6) 

which is known as the Fourier integral representation. From this, we can writ 
the two equations 


(11.7) 


which are the Fourier and inverse Fourier transforms. Properties of this trans 
form pair will be discussed in the next lesson along with problems using thes. 
transforms. 6 



NOTES 

1. The Fourier transform F(£) of f(x) can be a complex function ; for example 
the Fourier transform of 



The absoime value of the Fourier transform is the frequency spectrun 
°t/(.r). For example, in note 1, the frequency spectrum of f(x) is 
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(the reader should be able to find the magnitude of a complex number). 

3. Not all functions have Fourier transforms (the integral (11.7) may not exist); 
in fact,/(x) = c, sin x, e x , x 2 , do not have Fourier transforms. Only functions 
that go to zero sufficiently fast as |x| — * » have transforms. In applications, 
we apply the Fourier transform to temperature functions, wave functions, 
and other physical phenomena that go to zero as |x| -* «. 


1. What is the Fourier series expansion of the square sine wave 

,, , f - 1 - 1 < .r < 0 

^ ( 1 0 « .t < 1 

f(x + 2) = f(x) (periodic condition) 

Graph the first 2, 3, 4 terms of the series to see how it is converging to f(x). 
Also graph the frequency spectrum of f(x). 

2. Show that if we differentiate the Fourier series expansion (11.3) of the 
sawtooth wave term by term, we arrive at an infinite series that clearly does 
not represent the derivative of the sawtooth curve. 

3. Graph the frequency spectrum of the following periodic functions: 

(a) f(x) = sin x 

( b ) f(x) = sin x + cos 2x 

( c ) f(jc) - sin x + cos x + 0.5 sin 3x 

4. What is the Fourier transform F(fj) and the frequency spectrum C(f|) = 
|F(f;)| of the function 

" f 1 -T< .t"< T 

• |0 elsewhere 

5. Show that the absolute value of the function F(£) = 1/(1 + i£) is |F(^)| = 
Vl/(1 + €*). 

HINT First multiply the numerator and denominator by 1 - if; to get rid of the 
complex number i in the denominator. 

6. Verify the orthogonality properties of sines and cosines on the interval 
{-L.L) 


n (rmrxlL) sin ( wtxiL ) dx = \ 
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J ^ cos (m-A/L ) cos (n~xiL) dx = 

I sin {m-xIL) cos (ntix/L) dx =0 all m, n = 1. 2, 3, . . . 


OTHER READING 

Partial Differential Equations of Mathematical Physics by Tvn Myint-U. Elsevier, 1973. 
A well-written text with a fairly extensive section on the Fourier series and transform 
(Chapters 5. 1 1). Most of the important questions dealing with whether a function actually 
has a Fourier series or integral representation, whether the representation can be dif- 
ferentiated term by term or under the integral to get the derivative of the function, and 
so forth, are answered in these chapters. 



88 Diffusion-Type Problems 


LESSON 12 

The Fourier Transform and Its 
Application to PDEs 


: £ URP °SE OF LESSON: To illustrate several useful properties of the 
■ phfT r transform . and t0 show how th « e properties can be used to solve 
| P f, J" P art,cu ar V »t is shown how the Fourier transform changes dif- 
j ferennauon to mulitphcation, so differential equations change into aleebraic 
, ec l uat,ons - Also, the idea of the infinite convolution is introduced." 


formu° a Uri ' r ‘ ra " Sf0rm ° f ' he M lor -«<*<« is given by the 


( 12 . 1 ) 

' function JW *** on the real substitute it into 

equation (12 1), and arrive at the new function F($ for -»<?<== For 
example, Table 12.1 lists some common Fourier transforms. 

TABLE 12.1 Some Common Fourier Transforms 
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The reader can refer to the tables in the appendix for additional transforms. We 
can see from the examples that the transformed function F(£) may or may not 
be a complex-valued function of £. In the first example, the transformed function 
F(?) contains the complex number i, so we call it a complex-valued function of 
the real variable § (£ ranges from -* to °°). In other words, the argument 4 is 
real, but the value of the function is complex. 

The usefulness of the Fourier transform (as with most integral transforms) 
comes from the fact that it changes the operation of differentiation into multi- 
plication; that is, differential equations are changed into algebraic equations. 
There are also a host of other properties that make the Fourier transform a 
useful operational tool; we list a few of the more important ones. 


Useful Properties of the Fourier Transform 

Property 1 (Fourier Transform Pair) 

The Fourier transform of f(x), -» < x < *>, produces a new function F(f) 
defined by the formula 

m = = j L j _J(x)e-^ dx 

and the inverse Fourier transform of F(£), -« < £ < * will reproduce the 
original function f(x) according to 

2 F-‘[F] = f(x) = f_" F(t)e‘f d$ 


For example. 



FIGURE 12.1 Graph of a function and its transform. 


Property 2 (Linear Transformation) 

The Fourier transform is a linear transformation; that is 


m - bg\ = am - b9[g\ 

This is easy to see. The reader can spend a few minutes to verify this property, 
which is used over and over again. For example, the Fourier transform of the 
expression 



would be 

2 F[-^-j]+ me-' 1 ] 

Property 3 (Transformation of Partial Derivatives) 

When we discuss how derivatives transform, we must distinguish partial deriv- 
atives with respect to various variables. For instance, if the Fourier transform 
transforms the x-variable (the variable of integration in the transform) and if 
the function being transformed is a partial derivative of a function u(x,t) with 
respect to x, then the rules of transformation are 

^ u,(x,t)e-* dx = i&[u\ 

nuJ = vm L u M e "* dxm - 

On the other hand, if we transform the partial derivative u,(x,t) (and if the 
variable of integration in the transform is x), then the transform is given by 

Hu,] = i f_ M U,(x,t) e-*dx = J t V[u] 

5(«„] = ^ 7 = u„(x,t)e-“* dx = jp &{, u \ 

Property 4 (Convolution Property) 

Every integral transform has what is called a convolution property. The general 
idea is that the transform -of a product of two functions t\x)g(x) is not the product 
of the individual transforms; that is, 

p\Rx)g{x)\ - mm 

However, in transform theory there is something called the convolution / > g 
of two functions that more or less plays the role of the product. What is true 
about this convolution / * g is that 
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( 12 . 2 ) 


:r[f * g] = nm 

So what is this mysterious convolution / * g? It's given by the formula 

(113) (/ ' g H.v i = j J(x ~ dt 

and it can be shown without too much trouble that (12.2) holds. We see from 
the definition of the convolution that given two functions fix ) and g(x). the 
convolution ( f * g)(x) is a new function. 


Example of a Convolution of Two Functions 

Given the two functions 

m=x 

gM= 

the convolution is given by 

= xlVl (a new function)- ' -l- 5 

We have used the formula 

j e~ ( ‘ di = \Ar 

to arrive at this value. 

The importance of tin convolution (12.3) in applications is due to the fact 
that quite often, the final step in solving a PDE boils down to finding the inverse 
transform of some expression that we can interpret as the product of two trans- 
forms that is. we must find 

(12.4) 

By taking the inverse of each side of (12.2), we arrive at the result 



(12.5) /* g = 9-'{9\f]9\g)} 
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!- 'i- 


Hence. to find (12.4), all we have to do is find the inverse transform of each 
factor to get / and g and then compute their convolution. We are now in a 
position to work an important problem in PDE theory. 


Solution of an Initial-Value Problem 

Consider the heat flow in an infinite rod where the initial temperature is u(x,0) 
= <b(x). In other words, we look for the solution to the initial-value problem 
(I VP), sometimes called a Cauchy problem 

(12.6) PDE u < = -x<jr<* 0 < t < *■ 

IC w(x,0) = 4>(x) — x<A<* 

There are three basic steps in solving this problem. 


STEP 1 (Transforming the problem) 

Since the space variable x ranges from - * to *, we take the Fourier transform 
of the PDE and IC with respect to this variable x (the variable of integration 
in the transform is x). Doing this, we get 

*[«,) = 

9'[«(x,0)j = S*[4>(x)] 

and using the properties of the Fourier transform, we have • 


U( 0) = $(€) («f> is the Fourier transform of (f>) 

where £/(/) = 9[u(x,t)]. The reader should note here that the function U actually 
depends on both t and the new transformed variable £, but, for simplicity, since 
4 is a constant insofar as the differential equation (12.7) is concerned, we will 
drop the notation and just call U = U(t). 

STEP 2 (Solving the transformed' problem) 

Remember the new variable fj is nothing more than a constant in this differential 
equation, so the solution to this problem is 

(12.8) U(t) = <!>(£) 

STEP 3 (Finding the inverse transform) 
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To find the solution u(x,t ), we merely compute 
u(x,t) = :?-'[£/(£/)) 

Here « where the convolution theorem (12.5) comes to the rescue. Using this 
property, we can write 

u(x,t)= ^ 

( 12 ‘ 9 ) = <K X ) * J^~ yj— t e“ ( - rW ' ) j (using tables) 



We’re done; equation (12.9) is the solution to our problem. 

Before stopping, however, let’s analyze this result. Note that the integrand 
is made up of two terms 

1. The initial temperature *(*) 

2. The function G(x,t) = (which i$ ca)led Grecn>s 

function or the impulse-response function) 

It can be shown that this impulse-response function G(x,t) is the temperature 
response to an initial temperature impulse at * = $. In other words, G(x,t) is 
the temperature along the rod at time t due to an initial unit impulse of heat at 
x = f; (Figure 12.2). 



FIGURE 12.2 Impulse response G(x,t) from a temperature impulse at x = f. 
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Hence, the interpretation of solution (12.9) is that the initial temperature ti(x,0) 
= <b(jc) is decomposed into a continuum of impulses of magnitude d>({j) (at each 
point x = fj) and the resulting temperature <t>(f;)G(.r.r) is found. These resulting 
temperatures are then added (integrated) to obtain solution (12.9). Later, we 
will see that this general idea is known as superposition. 

From a practical point of view, solution (12.9) can often be integrated for 
some particular initial temperature 4>(x). If this integration cannot be carried 
out analytically, the solution can be found at any point (x,t) by numerically 
integrating the integral. 


The major drawback of the For 
transformed; for example, even 


? ourier transform is that all functions can not be 
:n simple functions like 

f(x)= constant 
f(x) = e* 
f(x) = sin .t 


cannot be transformed, since the integral 


does not exist. Only functions that damp to zero sufficiently fast as |x| -» « have 
transforms. Also, the Fourier transform could not be used to transform the time 
variable in the previous initial value problem, since 0 < t < 


1: Find the Fourier transform of ^ — 

,, s fo .V«° 

M = {e-' 0 < x 

Check your answer by using the tables in the appendix. 

2. Verify that the Fourier and inverse Fourier transforms are linear transforms. 
3: Solve the initial-value problem 

' • • >DE u r = ct\, -* - v < * 

IC w(x,0) = e' ,: -x < x < x 

by using the Fourier transform. 

4. Verify the properties 
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9[u.]~ it9[u) . • 

*[«„]■- ;• .> t 

HINT Use integration by parts. 

5. Verify that the convolution of two functions/and g can be written as either 

0~g)(x)= -7Z= I /I.v - t)g(i)di 

X i77 J-'- 

or 

(S*g)(*) m /_,/(«)«(* - 4 ) 

OTHER READING 

Fourier Series and Orthogonal Functions by H. Davis. Allyn and Bacon, 1963; Dover, 1989. An 
excellent book gives the reader an intuitive as well as rigorous viewpoint of Fourier series and 
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LESSON 13 


The Laplace Transform 


PURPOSE OF LESSON: To introduce the important transform pair 

£\f] = F(s) = jf f(t)e~’' di (Laplace transform) 

= /(/) = 2~. J ^ F{s)e s ' ds (inverse Laplace transform) 

and illustrate useful properties . The Laplace transform has an advantage over 
the Fourier transform because it contains the damping factor e that allow us 
to transform a wider class of functions. Inasmuch as the transform operates on 
functions defined on (0,*), it is mostly applied to the time variable t. 

After discussing some useful properties of the Laplace transform, we will 
solve an important problem in PDE theory. 


Of all the integral transforms we will study in this book, the Laplace transform 
(13.1) X\f\ = l f(t)e-« dt 

is probably the only one the reader has seen before, since it is a very powerful 
tool for transforming initial-value problems in ODE into algebraic equations. 
Not only is the Laplace transform useful in transforming ODEs into algebraic 
equations, but now we will use the Laplace transform to transform PDEs into 
ODEs. In particular, we will attempt to apply the Laplace transform to any 
variable x, y. z, t, . . . that ranges from 0 to * (although it will generally be 
applied to time). The major difference in applying the Laplace transform to 
PDEs in contrast to ODEs is that now when the original PDE is transformed, 
the new resulting equation will be either a new PDE with one less independent 
variable or else an ODE in one variable. We must then decide how to solve this 
new problem (maybe by another transform, bv separation of variables, and so 
on). Before actually solving a very interesting problem, we enumerate some 
useful properties of this transform. 
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Properties of the Laplace Transform 

Property 1 (Transform Pair] 

The Laplace transform and its inverse are given bv 

(13.2) F(s) = jf f (t)e~" dt (Laplace transform) 

‘[^1 = fO) - J [_._ F(s)e“ ds (inverse Laplace transform) 

The Laplace transform has one major advantage over the Fourier transform in 
that the damping factor e~ u in the integrand allows us to transform a wider class 
of functions (the factor e*" in the Fourier transform doesn’t do any damping 
since its absolute value is one). In fact, the exact conditions that insure that a 
function /(f) has a Laplace transform are given by the following theorem: 

Sufficient Conditions to Insure the Existence of a 
Laplace Transform 

If 

1. /is piecewise continuous on the interval 0 « r « A for any positive A 

2. we can find constants Af and a such that |/(f)| Me" for all values of r 
greater than some number T 

then 


the Laplace transform <£[/(/)] = F(s) = j[ /(,)*-« dt exists for s>a 

We now list a few functions that have Laplace transforms and graph them on 
the j-axis. K 



FIGURE 13. la-1 3. 1c Graphs of a few Laplace transforms. 
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3. f{t) = sin (a»t) 

(pick M = 1 a = 0) 



(see Figure 13.1c) 


la 



4. /(r) = e*' (doesn't have a Laplace transform) 

In the definition of the Laplace transform, the variable s is taken to be a real 
variable 0 < s < =°. It is possible, however (often desirable), to extend this 
definition to complex values of s and, in fact, to evaluate the inverse Laplace 
transform 


2- ! [F) * Fluids 

We must often resort to contour integration in the complex plane and the theory 
of residues. We won’t bother ourselves with this topic here but will use the tables 
in the appendix for finding inverse transforms. 
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Property 2 (Transforms of Partial Derivatives] 

Suppose we have a function u(x,t) of two variables and wish to transform various 

partial derivatives u„, u x . u xx Since the Laplace transform transforms 

the t-variablc (variable of integration), the rules of transformation for partial 
derivatives are 

'J.[u.\ = u,(xj)c- >: dt = sU{x.s) - rr(.v.O) 

%(u„) = | u„(x,t)e~" dt = s : U(x,s) - ju(a.O) -u,(x,0) 

%[u x ] = I u x (x,t)e~" dt = ^-(a.j) 

^kJ = l u xx (x,s)e- s ' dt = ^j(x,s) 

where U(x,s) = %[u{x,t)]. The transform rules for u x and u xx are a result of a 
basic rule in calculus 

-f - 

while the rules for u, and u„ can be proven by using the integration by parts 
formula. 

Property 3 (Convolution Property] 

Convolution plays the same role here as it did in the Fourier transform, but now 
the convolution is defined slightly differently. 

Definition of the Finito Convolution 

The finite convolution of two functions f and g is defined by 

(/*£)(') = [fr)g« ~ 

= l f(< ~ r)g( t) dr 

(these two integrals are the same). In other words, in the finite convolution, we 
integrate from 0 to t instead of from - « to as we did in the infinite convolution. 
An example of the finite convolution of two functions 
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m = / 

g(t) = i 

would be 

if * S)(0 = l t {t - t) d- = m 

As in the case of the infinite convolution, the important propertv of this new 
convolution is that 

03 . 4 ) , x[f*g) = mm 

or the equivalent formula 

03-5) 2-{3[/J =/*g .... 

This property will allow us to find the inverse Laplace transform of a product 
of two functions (which we interpret as f£[/]i£[g]) by finding the inverses of each 
factor X\f\ and i£(g] to get / and g and then finding their convolution. For 
example 



We are now ready to work an important initial-boundary-value problem. 

Heat Conduction in a Semi infinite Medium 

Consider a large (deep) container of liquid that is insulated on the sides. Suppose 
the liquid has an initial temperature of «„ and that the temperature of the air 
above the liquid is zero (some reference temperature). Our goal is to find the 
temperature of the liquid at various depths of the container at different values 
of time. To do so, we must solve the problem 

PDE u, = u xx 0 < x < x () < / < oc 
(13.6) BC u x (0,t) - u(0,r) = 0 0 < r < =c 

IC m(a,0) = u„ 0 < a < * 

See Figure 13.2. 
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FIGURE 13.2 Diagram illustrating the heat-flow problem. 

transform transform ^b^m'eans^^th'e Laplace 

ranges from ° to ->■ 

(13.7) 0DE jJ, W - % - JrM 0 < * < =o 

3C - m 

IIVZ'bC^I S'f Bt i-“ ,he IC >- ™* » * second-order ODE 

in US ‘7)dVen ds ol.y o„ T n0,a "° n ° W ' Si "“ th ‘ <"«"'»<« equerion 

♦ a particular 

- — - ~ - - - W = e,evi * + C2e -«" + ± is . . 

't'd M,! “o" P S 0 c" '"'°o "" f S ? <13 ' 7) * ll0WS “ s “ '"e 

<1M) WW ‘-“"lwu } + 7 

Now for the las, s.ep. To find the .emperature we compn.e 

“M = a-'[u(jt.j)j 
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[we now put back s in t/(jc,j)]. To find this inverse transform, we must resort 
to the tables of inverse Laplace transforms in the appendix; they will give us 

(13.9) u(x,t) = «„ - u 0 [erfc(x/2Vt) - erfc (Vi + x/2Vt) e u * ,) ] 

where 

lrfcM = Vil ‘' fdi 

is the complementary-error function whose graph is given in Figure 13.3. 



If we spend a little time analyzing this equation and graphing it by means of a 
computer with a plotter attachment, we will see that it looks like Figure 13.4. 



Nom 

1. The Laplace transform can also be applied to problems where the PDE is 
nonhomogeneous (in separation of variables, the equation had to be ho- 
mogeneous), but the Laplace transform will generally work only if the equa- 
tion has constant coefficients (in separation of variables, we could have 
variable coefficients). The following table lists the types of problems the 
two methods will handle. 
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TABLE 13.2 Comparison of Laplace Transform and Separation of 
Variables 

Method 

Laplace Separation 

Transform of Variables 

Nonhomogeneous PDE 
Nonhomogeneous BC 
Variable coefficients 
Nonlinear equations 

2. The Hankel and Mellin transforms are also used to solve IBVPs and BVPs but differ 
from the Laplace transform in one regard. The Laplace transform converts derivatives 
to multiplication operations by means of a formula like 

2[y'] = sS\y) - y(0) ' 

whereas the Hankel and Mellin transforms convert differential operators to 
multiplication; for example, the Hankel transform 

H\y] = [ rJ 0 (£r)y(r) dr 

transforms the differential operator 

Hlv"(r) + - r y'(r)} = -?H[y] 

In this way, specific differential equations with variable coefficients (Bessel’s 
equation) can be solved. 

3. The Laplace transform (which transforms t ) can be interpreted as projecting 
the xr-plane onto the x-axis, and the original BCs, PDE, and IC are trans- 
formed into a new differential equation and BCs. See the following diagram. 



Mx\ -ftx)=a>^ 
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PROBLEMS 


1. Verify the following formula for the transform of the partial derivative u, 

iC|u r (x.r)] = sU(x.s) - h(a.O) 

2. Solve the following initial-value problem by means of the Laplace transform 

PDE u, = crw„ -x < x < x 0 < / < x 
IC u(x, 0) = sin x - x < x < * 

3. Solve the problem 

PDE u, - u xx 0 <-x < x 0 < i < x 

BC u(0,t) = sin t 0 < t. < x 

IC u(x, 0) = 0 0 « x < x 

by means of the Laplace transform (transform t). What is the physical inter- 
pretation of this problem? 

4. Solve the boundary-value problem 


ODE 


0 < A < 1 

BCs 



— 

lf/(D = o 




OTHER READING 

1. A First Course in PDE by H. Weinberger. Ginn and Co.. 1965. This text contains 
an extensive section on contour integration, which is the tool used for evaluatine the 
inverse Laplace transform. 

Almost any beginning text in ODE will contain a chapter on the Laplace transform. 
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LESSON 14 


Duhamel's Principle 


PURPOSE OF LESSON: To show how the Laplace transform can 
ferenfT inte : estm8 under| y‘ng phenomena concerning solutions of dif- 
ferential equations, in particular, by algebraically manipulating the Laplace 
transform of the solution of a PDE, we discover an interesting idea known 
K Duharnel s principle. This principle has interpretations in ODE, but we 
Value p U robtm “ ^ * the C ° nteXt ° f 3 S ? ecific -tial-boundary- 


In addition to providing a powerful tool for solving PDEs, the Lanlace transform 
heln^Tth C r inS . i8ht int0 ' he nature of solutions to physical problems. With the 

c h 0 e we in r trate K a very import3nt - nd 

zS " 0 n as Y uhame l s P nnci pk in this lesson. Before getting to this 
principle, however, let s discuss a problem that occurs frequently in engineering. 


Boundaries^** 1 ' 11 ° R ° d Wilh Tem P®~*“re Fixed on the 

i iS « ">= temperature inside a medium due to dme- 


1 «(o ,0 = o 

v “(i.o = m 


FIGURE 14.1 Time-varying boundary conditions. 
106 Diffusion-Type Problems 



Duhamel's Principle 107 








Easy Problem (14.2) (Cont.) 
(constant BC) 


X[w,) = sW - w(x.Q) 



U(x,s) = F(s) <£[*,] 

Hence 

u(x,t) = X-' {F(s)^[w',]} 

= 2-TO]-M‘ 

= /(O ' w M' 

= l /W K(x,t- t) d T 
(or by integration by parts) 

= j. w(x,t — t) f'(-r) d-t + 
/(0)w(x,0 

(solution to the time-varying problem 
in terms of the.solution of the constant 
BG problem) . . ' ' • • . 

In other words, we have found the solution u(x,t) to the time-varying problem 
in terms of the solution to the easy problem (constant BCs).; that is, 

,14.3, «(W)- (»,(«- ,)/(,)* 

= l w(x,t - t)T’(t) dt + /(0M*,0 

Equations (14.3) are known as Duhamel’s principle. Vve can now take the so- 
lution w(x,f) to the constant BC problem 

w(x,t) = x + - X ~ ~ e sin (nirx) 

and substitute it into equation (14.3) to obtain the solution to the time-varying 
problem [we must use the second equation in (14.3), since if we differentiate 



Hard Problem (14.1) (Cont.) 
(time-varying BC) 

Using the relationship 
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the infinite series representation for w(x,l) term by term (with respect to /), it 
results in a divergent series]. 

There is another aspect of Duhamel’s formulas that makes them very useful. 


The importance of Duhamei’s Principle 

in the problem just discussed, we were able to solve the easy problem with 
constant BCs, so we used Duhamel’s formulas (14.3) to obtain the solution to 
the time-varying BCs. Quite often, however, even the easy problem (constant 
BCs) cannot be solved analytically. What we can do, however, is observe the 
solution experimentally ; in other words, we can rig a device that has constant 
BCs and experimentally measure the response. We can then use Duhamel’s 
principle to find the solution for any time-varying BC. In fact, we have only to 
observe the response w(x,r) to the constant BC problem once. When we have 
this data, we can then solve the problem with arbitrary BC/(f) by substituting 
into Duhamel’s formulas (14.3). 




De?amrr/!?/^nl t w. t r Pera,Ure ,r SP0nSe U{XJ) t0 an arbitrar V boundary tem- 
perature /(f) once we have earned out an experiment to determine the temoer- 
ature response w(x,t) from an impulse temperature. P 

PROBLEMS 

L a P n 7,M h ,',° U rf hamel pri “ iple (,4 ' 6) transforming both problems (14.4) 
lesson 4 5 d § a " argument s,miIar t0 the one for Ending (14.3) in the 

HINT The Laplace transform of the impulse function 5 (/) is i£[5(f)] = 1. 
2. Show that the partial derivative w, of 


diverges for all a: if we differentiate the series term by term 
3. Suppose we have a metal rod (laterally insulated) and we supply an initial 
TJZoL°L heat - a V he nght ‘ hand side ( the left-hand side is ffxed at zero). 

tem P erature of the rod I* ^ro (some reference temper- 

Se of time TthTV' th ! midp ° int * “ °- 5 is measured at various 
values of time, so that we have the following table: 

Values of Time Midpoint Temperature 


' polTnto S 5 d 7'dt7°,ho "“ tempera, urn "*po„se « 


(a) u(l,t) = sin t 

(b) u(l,t) - f(t) (arbitrary /(r)) 

Using Duhamel’s principle, what is the solution of the IBVP 
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OTHER READING 

1. Differential Equations by C. Wylie. McGraw-Hill, 1979. Duhamel’s principle is dis- 
cussed in conjunction with problems in ODE in Chapter 6 of this text. 

2. Equations of Mathematical Physics by A. N. Tikhonov and A. A. Samarskii. Mac- 
millan, 1963: Dover, 1990. An excellent source of all kinds of applied problems; the Duhamel 
principle is discussed on page 261. 
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LESSON J5 

The Convection Term u x in the 
Diffusion Problems 


PURPOSE OF LESSON: To show how the term u x in the diffusion 


Diffusion Convection 


represents the phenomenon of convection. Phenomena described by this 
convection-diffusion equation exhibit both diffusion and convection prop- 
erties and are common in many situations. How much diffusion and con- 
vection takes place depends on the relative size of the two coefficients D 
and V. 

Inasmuch as the convection of a substance represents material moving 
with the medium, it is possible to pick a moving coordinate system that „ , 
moves with the medium. In this way, the convection term is eliminated 
and the equation can be solved in terms of the moving coordinate and then 
transformed back into the original variable x. 


So far, we have been concerned with heat flow (or diffusion of some kind) in 
a one-dimensional domain. Suppose now we consider the problem of finding 
the concentration of a substance upwards from the surface of the earth where 
the substance both diffuses through the air and is carried upward (convected) 
by moving currents (moving with velocity V). Clearly, it is possible for the 
convection of the substance to contribute more of a movement in the substance 
than the diffusion itself. (It would depend on the relative size of the diffusion 
coefficient and the velocity of the air.) Diffusion is mixing the substance through 
the air. while convection is the movement of the substance by means of the air 
(the movement of the medium); in any case, it is our purpose here to solve the 
diffusion-convection equation 
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and to show how 1 it is derived. 

, To verlf > this equation for a concentration u(x,t) of a substance, we use two 
baste jacls 

1. Flux due to convection 

The flux of material (from left to right) across a point due to convection 
is given by 1 u(x.t). where V is the velocity of the medium (cm 'sec) and 
mx.n is the linear concentration tg em) (Figure 15.1). 



-IGURE 15.1 Amount of material across x (per second) due to convection 
is Vu[x.t). 

2. Flux due to diffusion 

The flux of material (from left to right) across a point a- due to diffusion 
is given by - Du,(x,t). where D is the diffusion coefficient. 

If we substitute these two expressions into the conservation equation in Lesson 
4. we can prove that the basic PDE is 



To get an idea of what solutions look like or how they behave with the convection 
term included, let’s first work a problem that is pure convection (the diffusion 
term is zero). A typical problem would be dumping a substance into .a clean 
river (moving with velocity V) and observing. the concentration of the substance 
downstream. For example, if x measures the distance downstream from, where 
the substance is added and if the substance does not diffuse with the running 
water then the concentration of the substance u(x.t) can be found by solving 
the following mathematical model: 

PDE u, = - Vu x 0 < x < oc 0 < / < * 

15.1) BC «(0,0 = P * Constant input of the substance 

IC u(x, 0) = 0 Initially a clean river 

This problem is illustrated in Figure 15.2. 



-IGURE 15.2 Pure convecfion problem. 
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Before solv.ng this problem, we should think a little about what the solution 
should be. It's obvious that the pollutant (substance in the river) will initially 
be zero, but once it is added at a constant rate at * = 0, it will move downstream 
wuh veiocty V. To see this mathematically, let's solve (15.1). Since it is a linear 
PDE with linear BCs, we should think in terms of separation of variables and 
integral transforms; however, since the x-variable is unbounded, separation of 
variables is out. Let’s use the Laplace transform on t. 


Laplace Transform Solution to the Convection Problem 

The convection problem (15.1) can be replaced by 


by using the Laplace transform 


u ( x ) = J u(x,t)e~ n dt 


Solving this very simple initial-value problem, we get 


Looking up the inverse transform in the tables, we see 
u(x,t) = <£-<[(/] = PH{t - x!V) 


where H(£) is the Heaviside function (step function) 


Hence, the solution of our problem is just 


j O t < xlV 
IP t 5* XlV 


This was pretty simple; certainly, it isn’t any more complicated than dumping 
something on a conveyor belt and watching it move along. It does however 
become more interesting when the solute (pollutant) diffuses with the medium! 
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u ix, 01 '0 

FIGURE 15.3 Pure convection wave. 


To see what happens when a moving wave diffuses, we solve the following 
problem: 

(15.2) PDE u, = Du„ - Vu x - * < x < * 

IC «(x,0) = 1 - H(x) -» < x < * 

where, as usual, H(x) is the Heaviside function. The initial concentration is 
shown in Figure 15.4. 

1 - HOci --Q l<° 0 

0 

FIGURE 15.4 Initial condition for the diffusion-convection equation. 

Note that in the new problem (15.2), we have moved the boundary to -« (we 
now have an initial-value problem), so that it doesn’t confuse the real issue of 
measuring the relative effects of D versus V (just a technicality). To solve (15.2), 
we could use the Laplace transform on t or the Fourier transform on x; however, 
in this case, there is another alternative that is very interesting. That is, instead 
of measuring the concentration u(x,t ) as a function of x, we introduce a new 
coordinate 5, which moves along the x-axis with velocity V. In other words, 
instead of placing our coordinate system along the bank of the river (so to 
speak), we now place our coordinate system so that it moves with the wave front 
(of course, now when we .have diffusion in addition to convection, we won’t 
have a sharp wave front). Mathematically this says that we change our space 
coordinate x to ( = x - Vt. It’s now clear that 

when 5 = 0 we are on the wave front 
when 5=1 we are one unit ahead of the front 

when 5 = — 1 we are one unit behind the front 
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So our goal is to transform the initial-value problem (IVP) 

PDE u. = Du xx - Vu x -oc < x < x 

IC mx.O) « 1 - H{x) — «.<*< x 

into a new one in the moving coordinate system, soive it. and then transform 
back to get the solution in terms of the original coordinates (*./). To begin, we 
make what is called a dualize of variables (change of independent variables). lit 
place of the old coordinates (x,l), we introduce new ones 

4 = x - Vt 


The reader should note that t is the same as t. but it is less confusing if we give 
it a new name. To rewrite the PDE in terms of (£.?), we use the. chain rule 

u, ~ + u t t, = — Vu s + w, 

u x = u& = 

= (M t )x = = «« 

Using functional diagrams, as in Figure 15.5. makes these chain-rule arguments 
clearer. 



FIGURE 15.5 Diagram illustrating functional dependence of variables. 

The diagram in Figure 15.5 is useful for computing the partial derivatives of u,u t 
with respect to x and r, since it shows exactly how u and u 4 depend, in general, 
on 4 and t and that £ depends, in turn, on both x and r. The variable t, on the 
other hand, depends only on t. 

So much for the transformation. We now substitute our computed u„ u x , and 
u xx into the PDE to get 

— Vu i + w, = Du k - Vu t 

or ' 


116 Diffusion-Type Problems 



Finally, to get the solution of our problem in terms of the coordinates .r and t 
we substitute 


?« * - Vt 

into equation (15.3) to get 



This is the solution of our diffusion-convection problem (15.2), and it is really 
very easy to interpret; it’s just a moving version of Figure 15.6. In other words' 
depending on the relative size of D (diffusion coefficient) and V (velocity of the 
stream), the solution moves to the right with velocity V while, at the same time 
the leading edge is diffusing at a rate defined by D (Figure- 15.7 shows the break 
up of the leading edge). 



FIGURE 15.7 Diffusion-convection solution moving and diffusing at the same 

NOTES 

Changing coordinates is a very important technique in PDEs. By looking at 
physical systems with different coordinates, the equations are sometimes sim- 


PROBLEMS 


1. Solve the initial- value problem 


- * < X < x 
-* <.,*'< x 


0 < t < X 


2. Solve the following diffusion-convection problem by making a transforma- 
tion as shown in Lesson 8: 

u, = u„ - 2 m, - x < < x 0 < r < * 

m(.v.O) = e‘ sin .r - x < * < * 

3. What is the solution of the following convection problem: 

PDE u, = -2m, -x < x < * 0 < t < * 

IC u(x, 0) = 

Check your answer. 

4. Solve 


m, = Dm„ - Vu x -»<.«■<» 0 < f < * 

u(.t,0) = e~“ : -x<x<» 

Does the solution check? What does the solution look like for various values 
of time? 

HINT Note that our transformation to moving coordinates allows us to 
essentially neglect the term Vu, in the PDE. After solving the new problem, 

PDE m t = Dm m -x<§<x 0 < t < » 

IC u(&0) = e-* ! - x < £ < » 

we merely set £ = .r - Vt and t = t. In this particular problem, it is possible 
to evaluate the integral 

This is the Fourier transform solution from Lesson "I2TIt may be more 
convenient for the reader to rewrite this integrand and then look it up in 
a table of integrals. 
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PACT 3 

Hyperbolic-Type 

Problems 



LESSON 16 


The One-Dimensional Wave 
Equation (Hyperbolic Equations) 


PURPOSE OF LESSON: To introduce the one-dimensional wave 
equation 


and show how it describes the motion of a vibrating string. It is also shown 
how this equation is derived as a result of Newton’s equations of motion. 
In addition, a few other variations of the wave equation, such as 

u„ = a. 2 u xx + F(x,t) 

u„ - a 2 u xx - Pm, - \u + F(x,t) 

are discussed. 


So far, we have been concerned with physical phenomenon described by one- 
dimensional parabolic equations (diffusion problems). We will now begin to 
study the second major class of PDEs, hyperbolic equations. We start by studying 
the one-dimensional wave equation, which describes (among other things) the 
transverse vibrations of a string. 


Vibrating-String Problem 

We consider the small vibrations of a string that is fastened at each end. We 
assume the string is stretched tightly, made of a homogeneous material, unaf- 
fected by gravity, and that the vibrations take place in a plane (Figure 16.1). 



FIGURE 16.1 Transverse vibrations of a string. 
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To mathematically describe the vibrations of this string, we consider all the 
forces acting on a small section of the string (Figure 16.2). 



FIGURE 16.2 Small segment (x, x + Ax) of the vibrating string. 

Essentially, the wave equation is nothing more than Newton’s equation of motion 
applied to the string (the change in momentum mu„ of a small string segment 
is equal to the applied forces). Looking at Figure 16.1, we can imagine several 
forces acting on the string in the direction perpendicular to the x-axis. 

The most important forces are 

1. Nel force due to the tension of the string (o t 2 u xx ) 

The tension component has a net transverse force on the string segment 
of 

Tension component = T sin 8- - Tsiri 6, 

s T[u x (x + Ax,/) - u,(x,t)] 

2. External force F'.x,t) 

An external force F{x,t) may be applied along the string at any value of 
x and r; some examples would be. 

(a) gravity F(x,t) = —mg 

(b) impulses along the string at different values of time 

(c) in the two-dimensional wave equation (which we will study later) 
that describes the vibrating drumhead, a force could be applied 
by sound waves impinging on the surface of the membrane. 

3. Frictional force against the string ( — p«,) 

If the string is vibrating in a medium that offers a resistance to the string's 
velocity u,. then this resistance force is - p u, 

4. Restoring force yu) 

This is a force that is directed opposite to the displacement of the string. 
If the displacement u is positive (above the x-axis), then the force is 
negative (downward) 

If we now apply Newton's equation of motion 
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mu,. = applied forces to the segment (x.x + Ax) . 

to the small segment of string, we have 

Axp«„ = T[u x (x + Ax,/) - u x (x,t)J + A xF(x,t) - Axp u,(x.t) - A xyu(x,l) 

where p is the density of the string. By dividing each side of the equation bv Ax 
and letting Ax — * 0, we have the well-known telephone equation 

(16.1) u„ = a 2 u xx - p u, - yu + F(x, t) 

which is the equation we wanted to derive [note that p, -y, and F(x,t) in equation 
(16.1) should be divided by p, but we will relabel them as p, y, and F for 
simplicity]. We will now present an intuitive interpretation of the simple wave 
equation. 

(16-2) u„ = a\ x 


Intuitive Interpretation of the Wave Equation 

The reader may ask why we would expect an equation like (16.2) to describe 
something like the vibration of a violin string. To answer this, we must under- 
stand that the expression u„ represents the vertical acceleration of the string at 
a point x. Hence, equation (16.2) can be interpreted as saying that the accel- 
eration of each point ofthe string is due to the tension in the string and that the 
larger the concavity u„, the stronger the force (the proportionality constant is 
a 2 = Tig). See Figure 16.3. 



FIGURE 16.3 Interpretation of the wave equation u„ = a 2 u x 


NOTES 

!. The wave equation u„ = a 2 u xx also describes longitudinal and torsional 
vibrations of a rod. In these vibrations, the displacement is parallel to the 
rod (like hitting the end of the rod with a hammer), and «(x,/) stands for 
the longitudinal displacement of a point on the rod from its equilibrium 
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position. The PDE can be derived in more or less the same way as in the 
transverse-vibrations case and it is given by 

w„ = ku„ 

• where k IS a physical parameter known as Young’s modulus (which is a 
measure of the elasticity of the rod). Materials that have large Young’s 
moduli vibrate rapidly; sound waves also constitute longitudinal waves. 

If the vibrating string had a variable density p(x), then the wave equation 
would be: n 


^ ^ ot hej words, the PDE would have variable coefficients. 


,u(x,0) = f(x) (initial position of the string) 

J u,(x,0) = g(x) (initial velocity of the string) 

in order to uniquely define the solution for t > 0. This is in contrast to the 
heat equation, where only one IC was required. 

4. Another situation that can be described by the one-dimensional wave equa- 
tion is an electric current along a wire. With the help of Kirchhoffs laws 
we can arrive at a system of two first-order PDEs 

(16-3) i x + Cv, + Gv » 0 

v, + Li, + Ri = 0 


Since the wave_eq uation u„ - a-u rx contains a second-order tim e deri vative 
u„, it requires two i nitial conditions 


x = location' along the wire 

t = time 

i = current along the wire 
v {x,t) = potential along the wire 
C = capacitance/unit length of wire 
G = leakage conductance/unit length of wire 
R = resistance/unit length of wire 
L = sell-inductance, ''unit length of wire 


Equations (16.3) are the well-known transmission-line equations and are not 
generally left in this form, but are further manipulated. This is bv differ- 
entiating the first equation with respect to .v and the second with respect to 
/. multiplying by C, and then subtracting, we have 
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ICs 


f il(A-.O) = 0 
l«Xx.O) = 0 


What is the physical interpretation of this problem? 

4. How many solutions of u„ = u xx can you find by looking for solutions of the 
form 

u(x,i) = e " * b ' 

Is the sum of two solutions a solution? 

OTHER READING 

Elementary Partial Differential Equations by P. Berg and J. McGregor.. Holden-Day, 
1966. An excellent reference text. 
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LESSON 17 

The D'Alembert Solution of the 
Wave Equation 


PURPOSE OF LESSON: To find the soluii, 
problem 


1 ufaO) - f(x) 
t«X*,0) = g(x) 


This problem (which has no boundaries) describes the motion of an infinite 
string with given initial conditions and was solved in about 1750 by the French 
mathematician D’Alembert. This so-called D’Alembert solution 

“M = \ [/(* " «) + f(x + cr)] + y c j[. e , 8(0 di 


is easyto compute once we'have the two initial conditions. In addition, this 
solution has interesting interpretations in terms of moving wave motion. 


If the reader recalls the parabolic case, we started solving diffusion problems 
when the space variable was bounded (by separation of variables) and then went 
or: to solve the unbounded case (where - * < x < °°) by the Fourier transform. 
In the hyperbolic case (wave problem), we will do the opposite. We start by 
solving the one-dimensional wave equation in free space. That is. the pure initial- 
value problem 

PDE u„ = c l u xx -x < x < oc 0 < r < x 


(17.1) 


ICs 


u (x,0) = fix) 
u,ix, 0) = g(x) 


We could solve this problem by using the Fourier transform (transforming x) 
or the Laplace transform (transforming t). but we will introduce yet a new 
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technique (canonical coordinates), which will introduce the reader to several 
new and exc.ting ideas; we now solve problem (17.1). This technique is basically 
the same as the moving-coordinate method of Lesson 15. 


D'Alembert’s Solution to the One-Dimensional Wave 
Equation 

We solve problem (17.1) by breaking it into steps. 

STEP 1 [Replacing (x,t) by new canonical coordinates (£,q)] 

To solve (17.1), it turns out that if we replace the two independent variables x 
and t by the two new space-time coordinates ((j,q) 

S = x + a 
t )= x - ct 

the PDE 


is transformed into 

- 0 

This is really very easy to see, since a simple application of the chain rule gives 
u ( + 

c(«t - «„) 
u tf . + 2 + u ^ 

c 2 («« " 

and, hence, substituting the expressions for u„ and u xx into the wave equation 
gives 

u t „ = 0 ' 

This completes step 1. 

STEP 2 (Solving the transformed equations) 

The idea now is that this new equation can be solved easily by two straightforward 
integrations (first with respect to § and then with respect to q). Integration with 
respect to (• gives " 
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,(£.71) = cb(/n) (an arbitrary function of q) 


and, secondly, integration with respect to q gives 
»(S,q) = <l>(q) + *(6) 

where 4>(t|) is the antiderivative of 4 >(t|), and >li(0 is any function of §. In other 
words, we can say that the general solution (all solutions) of 

w ? „ = 0 


(17.3) _ m(5.ti) = 4>(q) - Ml) 

where 4>(q), Ml) are arbitrary functions of q and (j, respectively. For example, 
the reader can check that the functions 

u(S,q) = sin q + ? 
u{l> q) = 1/q - tan ? 

= q J + e t 

are all solutions of u = 0. This completes step 2. 

STEP 3. (transforming back to the original coordinates x and t) 

To find the general solution (all solutions) to u„ = c J u„, we substitute 



u(t q) = d>(q) + 4<(0 

to get 

(17.4) u(x,t) - <b(.t - ct) -r- iU(jc + ct) 

This is the general solution of the wave equation, and it is interesting in that it 
physically represents the sum of any two moving waves, each moving in opposite 
directions with velocity c. For example, the functions 

u(x.t) = sin (,r - ct) (one right-moving wave) 
u(x.r) = (.v + ct) 2 (one left-moving wave) 

u(x.i) = sin (x - ct) + (x + ct) 2 (two oppositely moving waves) 
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would be three typical solutions. 

Figure 17.1 illustrates the simple (right) moving wave 

u(x,t) * e - u -" ): 


| Velociiy * c 


0 t . 2 

FIGURE 17.1 Right-moving wave u[x. t) = e - " - c '>* 

STEP 4 (Substituting the general solution into the ICs) 

If the reader remembers ODE theory, the general strategy for solving initial- 
value problems was to find the general solution and then substitute this equation 
into the ICs in order to find the arbitrary constants. In our current problem, we 
have an analogous situation; in order to solve our initial-value problem, we first 
found the general solution 

u(x,t) = 4>(* - ct) + 4<(* + ct) 

to the PDE (which contains two arbitrary functions) and 'now substitute this 
expression into the two ICs 

u(x, 0) = fix) 
u,(x,0) = g(x) 

to find the arbitrary functions <i>, Doing this, we get 

H 7 5) <K*) + 'I'M = f(x) 

— cd>'(jr) + al/'(x) = g(x) 

We now integrate the second equation of (17.5) to get a new expression in <t>(x) 
and U/(jt) [and then algebraically solve for 4>(a) and 4/(x) from the two equations). 

Carrying out this integration on the second equation of (17.5) by integrating 
from a 0 to x. we get ' . 

(17.6) -c6(x) + cMx) = | g(i) + K 
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07.5^0,^' S0,V ' f ° r * W “ d * W "° m ,h ' tirS ‘ ° f 

( 17 . 7 ) ££*<{) « 

*<-')• j/U) + 

and, hence, the solution to our problem (17.1) is 

(17.8) u(x,t) = I (f (x - c ,) + f(x + c/)] + ^ J"' g(Q dh 

This, is what we were aiming for, and it is called the D’Alembert solution to 
him. play around with the limits on the integral to verify for 

jTblem° r thCy C ° me ° Ut ,0 " ~ ^ 3nd " + c/; this com P letes the 

how e ,£ r n W Ii C ° m K Plete t , he . lesson - however, we present a few examples to show 
how the D Alembert solution is applied to specific problems. 

Examples of the D’Alembert Solution 

1 . Motion of an Initial Sine Wave 

Consider the initial conditions 

u(x,0) = sin x 
u,(x, 0) = 0 

The initial sine wave would have the solution 

u (x,t) = ^ [sin (* - ct) + sin (x + cr)] 

Thiscan be interpreted as dividing the initial shape u(*,0) = sin * into two equal 



, a :l then K ad r d,n V he ,W ° resultant waves as one moves to the left and the other 
wale form ( W Ve ‘° Ci,y C) ' ^ reader might try ,0 ima e ine the suiting 
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2. Motion of a Simple Square Wave 

In this case, if we start with the initial conditions 

w(jc.O) = (! <x<\ 

[U everywhere else 

• u,(x,0) = 0 

and then split the initial wave into two half waves and let each move in an 
opposite direction, we arrive at the wave motion shown in Figure 17.2. 



FIGURE 17.2 Initial wave decomposed into two traveling waves. 

3. Initial Velocity Given 

Suppose now the initial position of the string is at equilibrium and we impose 
an initial velocity (as in a piano string) of sin x 

u(x. 0) = 0 
u,(.r,0) = sin x 

Here, the solution would be 
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which represents the sum of two moving cosine waves. The reader should ask 
himself or herself if this solution is reasonable. 

This completes Lesson 17; in Lesson 18, we show how the D’Alembert so- 
lution can be used to draw useful interpretations in the .rr-plane. 

NOTES 

1. Note that a second-order PDE has two arbitrary functions in its general 
solution, whereas the general solution of a second-order ODE has two 
arbitrary constants. In other words, there are more solutions to a PDE than 
to an ODE. 

2. The genera! technique of changing coordinate systems in a PDE in order 
to find a simpler equation is common in PDE theory. The new coordinates 
(fj/n) in this problem are known as canonical coordinates , and we will discuss 
them further in later lessons, especially when we study hyperbolic problems. 

3. The strategy of finding the general solution to a PDE and then substituting 
it into the boundary and initial conditions is not a common technique in 
solving PDEs. The solution discussed in this lesson is the only one that 
utilizes this strategy. Usually, we cannot find the general solution to the 
PDE, and even if we could, it is generally too complicated to substitute it 
into the side conditions. 


PROBLEMS 

1. Verify that the general D’Alembert solution (17.8) satisfies the initial-value 

problem (17.1). 

2. Substitute (17.7) into the general solution 

u(x.t) = (|)(.r - ct) -r dj(jr + ct) 

to get the D’Alembert solution. 

3. What is the solution to the initial-value problem 

PDE /!„ = »,, -.x.-.): .v < * ()<-<* 


What does the solution look like for various values of time 0 
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PDE 


of the initial-value problem: 

-x < A- < x 0 < t < * 

0 . -x<a<x 

xe ' 

Graph the solution u(x.t) for various values of time. 

5 . Algebraically solve for 4>(*) and ti»(*) from the first equation in (17.5) and 
(17.6) to arrive at (17.7). 

OTHER READING 

Advanced Mathematics for Engineers by C. Wylie. McGraw-Hill. 1958. A readable pres- 
entation of some of the elementary ideas on PDEs. 
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More on the D'Alembert Solution 


Mn bffsfd .ffin!i E ih S0N: To . illus,rat « ho «' the D'Alembert solution 
be used to find the wave mot.on of a semi -in (ini, e-string problem 


BC u(Qj) = 0 0 < t < * 

ICs f(x) 0 <a<x 

Ia(-v.O) = S (x) 0^x<=: 

In addition, the D’Alembert solution is interpreted in the Arr-plane 


In the previous lesson, we found that the expression 

(18.1) "fr-0 - j W* - a) 4 . „)] , ±|"" s(5) di 

some interesting interpretation rf this enuittoj inT ^1! r 
S5^„i£ eq " a ' i0 ” C “ be o ' .he *2f' 

We start with our interpretation of (18.1) in the .tv-plane. 


The Space-Time Interpretation of D’Alembert’s Solution 

We proved in the last lesson the solution of the pure initial-value problem 


ICs = /M 

[m,(a,0) = g(x) 
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is given by 


Mx.t) = ~ [f(x - ct) + fix + ci)] + ^ ( g(£) 

We now present an interpretation of this solution in the j«-plane looking at two 
specific cases. 

CASE 1 (Initial position given; initial velocity zero) 

Suppose the string has initial conditions 

u(x,0) = f[x) 

«,(*. 0) = 0 

Here, the D’Alembert solution is 

“(x.t) = \ [f{x - ct) + f(x + cr)] 

and the solution u at a point (jc 0 ,/ 0 ) can be interpreted via Figure 18.1 as being 
the average of the initial displacement fix) at the points (*„ - cr 0 , 0) and (*„ 
+ cr„, 0) found by backtracking along the lines 



FIGURE 18.1 Interpretation of u(x. t) = ^ [f[x - ct) + \( x +■ c f)J in the 
x/-plane. 

For example, using this interpretation, the initial-value problem 
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PDE 


0 < r < 


(18.3) f 1 - 1 < -r < 1 

f W (x,0) = 

ICs t [0 everywhere else 

[uJLx. 0 ) = 0 


would give us the solution in the .rr-plane shown in Figure 18.2. 



FIGURE 18.2 Solution of the initial-value problem (18.1) in the xt-plane. 

Figure 18.2 is the .w-plane version of the solution graphed in Figure 17.2 in the 
previous lesson. 

We now interpret the D’Alembert solution when the initial position is zero, 
but the velocity is arbitrary. 

CASE 2 (Initial displacement zero; velocity arbitrary) ........ 

Consider now the IC 

u(.v,0) = 0 
u,(x,0) = glx) 

Here, the solution is 

id.v.r) - ^ [ !>(£) </t 

and. hence, the solution u at (.r „./„) can be interpreted as integrating the initial 
velocity between .e„ — tr„ and r„ + cr,, on the initial line r = 0 (Figure 18.3). 
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has a solution in the xt-plane illustrated in Figure 18.4. 



FIGURE 18.4 Solution to problem (18.4) in the x/-plane. 

Problem 18.4 corresponds to imposing an initial impulse (velocity = 1) on the 
string for - 1 < x < 1 and watching the resulting wave motion (as in the piano 
string).. To find the displacement, we compute the D’Alembert solution 
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d£ (.v./)e Region 2 




FIGURE 18.5 Solution of problem (18,4) for various values of time. 

This completes our interpretation of the D’Alembert solution in the *r-plane. 
In the remainder of the lesson, we will solve the initial-boundary-value problem 
for the semi-infinite string 

PDE u„ = C 2 U xt 0 < * < oe 0</<oo 

(18.6) BC u(0 ,t) = 0 0 < r < .« 


by modifying the D'Alembert formula. 


Formula ° f thG Semi " ln, ‘ nl,e strln 9 v ‘ a the D’Alembert 

The object now is to find the wave motion of the vibrating string whose left end 
is fixed at zero and has given initial conditions. To find the solution of (18 6) 
we proceed in a manner similar to that used with the infinite string, which is to 
find the general solution to the PDE 
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u(x,t) = (Kx - ct ) + i|/(x + ct) 

If we now substitute this general solution into the initial conditions as we did 
in Lesson 17, we arrive at (same equations) 

~ cf ) = \f( x ~ c ‘) ~ Y c [ ««> d $ 

(18.7) 

H* + «)= \j{x + ct) + 1 £ g(0 ^ 

We now have a problem we didn’t encounter when dealing with the m/mire 
string. Since we are looking for the solution u(x,t) everywhere in the first quad- 
rant (x > 0, t > 0) of the xr-plane, it is obvious that we must find 

«f)(x - ct) for all -oo < x - ct < oo 

iK* + ct) for all 0 < x + ct < oo 

Unfortunately, the first equation of (18.7) only gives us <|>(x - ct) for x - ct 
^ 0, since our initial data /(x) and g(x) are only known for positive arguments. 

As long as x - ct > 0, we have no problem, since we can substitute (18.7) 
into the general solution u(x,'r) = 4 >(jc - ct) + 4»(jc + ct) to get 

u(x,t)= 4>(jc - ct), + ij;(x + ct) 

= \ [f(x-~ ct) + /( x + cf)J + ^ j[_ w *(Q di- 

The question is, what to do when x < cf? This is where the BC u(0,r) = 0 comes 
into use. When x < ct, we use the BC of the problem to find <t>(x - ct). 

Substituting the general solution u(x,t) = 4>(x - cf) + d,(x + ct) into the BC 

u(0 ,/) = 0 gives 

<K~cf) = - i|i(cf) 

and, hence, by functional substitution 

c|>(x - cf) - - - x) - ± j[ g(£) d% + K 

Substituting this value of <t> into the general solution 

u(x,t) = <J>(x - cf) + t|»(x + ct) 

gives 
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Solution (18.8) would not be the same if the BC u(O.t) = 0 were changed. 
Solutions can also be found with other BCs. such as 




«(0.0 = f(t) 

H,(0 .() = 0 


The reader can consult the reference in the reading list for additional in- 
formation. 

The straight lines 


x -r ct - constant 
x - ct = constant 


arc known as characteristics, and it is along these lines that disturbances 
are propagated. Characteristics are generally associated with hyperbolic 
equations. 


PROBLEMS 

1. Solve the semi-infinite string problem 


PDE 

BC 

ICs 


U„ = W„ 0 < X < « 0 < 

u(0,0 = 0 0 < t < * 


U*,0) = 

KU-,0) = 0 


0 < f < 00 



Draw the solution for various values of time. 

The solution of the semi-infinite string problem in problem 1 can also be 
found by 

(a) extending the IC to the whole real axis -* < x < * via 


u(x',0) = - xe~* : -* < x < 0 

u,(x. 0) = 0 -=c <A -<0 


(b) averaging the two left- and right-moving waves as we did in the 
previous lesson 

(c) looking at the solution for r?0 

Use this idea to graph the solution (for various values of t) for the IC shown 
in the following diagram. 
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in a manner analogous to the way the semi-infinite string problem was solved 
in the lesson; what is the interpretation of this problem 9 
4. Suppose the vibration of a string is described by u„ = «„ and has an initial 
displacement as given by the following diagram. 



i ! | 1 j j 

, initia ‘ veloc »*y u i(x,0) = 0, describe the solution of this prob- 
lem in the jrr-plane. Note that in this problem, the IC u(x,0) is discontinuous. 


OTHER READING 

Techniques in Partial Differential Equations by C. Chester. McGraw-Hill 1971 Chanter 
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. LESSON 19 

Boundary Conditions Associated 
With the Wave Equation 

PURPOSE OF LESSON: To illustrate how the wave equation (with 
a bounded space variable) 

u„ = c*u xx 0 < x < L 0 < r < » 

is generally associated with one of three general kinds of BCs 

1. Controlled end points (first kind) 

“(0.0 = 5.(0 
“(M = 5,(0 

2. Force specified on the boundaries (second kind) 

“,(0.0 = 5.(0 
“,(M = 5,(0 

3. Elastic attachment (third kind) 

“,(0.0 - y.w(0 ,/) = gl {t) 

“,(M - hu(L,t) * g 2 (t) 

•(b r .a mixture of these). and . to illustrate the nature of solutions associated 

with these problems. 


So far, the only kind of wave motion we have discussed is the one-dimensional 
transverse vibrations of a string. The reader should realize that this is only the 
tip of the iceberg as far as wave motion is concerned. A few other tvpes of 
important vibrations are: 

1. Sound waves (longitudinal waves) 

2. Electromagnetic waves of light and electricity 

* 3. Vibrations in solids (longitudinal, transverse, and torsional) 

4. Probability waves in quantum mechanics 

5. Water waves (transverse waves) 
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6. Vibrating string (transverse waves) 

The purpose of this lesson is to discuss some of the various types of BCs that 
are associated with physical problems of this kind. Here, we will stick to one- 
dimensional problems where the BCs (linear ones) are generally grouped into 
one of three kinds: 

1. Controlled end points (first kind) 

“(0,t) = g,(r) 
u(L,t) = g,(t) 

2. Force given on the boundaries (second kind) 

“,(0./) = g,(r) 

“,(M = 5,(0 

3. Elastic attachment on the boundaries (third kind) 

“,(0.0 - y,«(0,r) = g,(t) 

“,(*■.') - y 2 u(L,t) = g 2 (t) 

We start by discussing BCs of the first kind. 

1. Controlled End Points 

We are now involved with problems like 

PDE u„ = c 1 u xx 0 < x < 1 0 < r < x 

(,9i) BCs {5$: £8 °<'<* 


ICs 


«(*,0) = fix) 
.“,(*. 0) = g(x) 



where we control the end points so that they move in a given manner (Figure 
19.1). 
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A .typical problem of this kind would involve suddenly twisting (at / = I) the 
right end of a fastened rod so many degrees and observing the resulting torsional 
vibration (Figure !9.2). 



FIGURE 19.2 Torsional vibrations of a rod. 

In the area of mathematical control theory, an important problem involves 
determining the boundary function £.(/). so that a vibrating string can be shaken 
to zero in minimum time. -■ 

2. Force Given on the Boundaries 

Inasmuch as the vertical forces on the string at the left and right ends are given 
bv Tu.(O.r) and Tu.(L.t). respectively, by allowing the ends of the string to slide 
vertically on frictionless sleeves, the boundary conditions become 

u x (0.t) = 0 
u,(L,t) = 0 

See Figure 19.3. 



FIGURE 19.3 Free BC on the string. 

Boundary conditions similar to these are presented in the following two ex- 
amples; 

(a) Free end of a longitudinally vibrating spring 

Consider a vibrating spring with the bottom end unfastened (Figure 19.4). 



FIGURE 19.4 Free end of a vibrating spring 
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(b) Forced end of a vibrating spring 

If a force of v(t) dynes is applied at the end a = 1 (a positive force is measured 
downward), then the BC would be 

U AU) = £i»(0 (k is Young's modulus) 

In the case of a forced BC, the ends of the string (or spring) are not required 
to maintain a given position, but the force that's applied tends to move the 
boundaries in the given direction. Physical problems like these come about in 
physics when an electric field (a force) is applied to vibrating electrons. 


3. Elastic Attachment on the Boundaries 

Consider finally a violin string whose ends are attached to an elastic arrangement 
like the.or.e shown in Figure 19.5. 



FIGURE 19.5 Diagram illustrating elastic attachment. 

Here, the spring attachments at each end give rise to vertical forces proportional 
to the displacements 

Displacement at the left end = w(0,r) 

Displacement at the right end = u(L,t) 

Setting the vertical tensions of the spring at the two ends 


Upward tension at the left end = 7u,(0,r) 
Upward tension at the right end = - Tu x {L,t) 


( T = string tension) 


deslredBCs 56 d * SplaCements ( multi P lied by the spring constant h) gives us our 


: 19.2) 


“.( 0,0 = \ «( 0.0 

u ,(L,t) = -j.u(L,t) 
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Note that u(0,t ) positive means that u x (0,f) is positive, while if u(L,t) is positive, 
then u x (L,i) is negative. We can rewrite these two homogeneous BCs asi 


“,(0,0 - ~ u(0,t) = 0 

u x(L,‘) + j. “(L,0 = 0 


If the two spring attachments are displaced according to the functions 6,(0 and 
6,(0, we would have the nonhomogeneous BCs 

( 19;4) “«(°>0 = | [“(0,0 - 9,(01 

“,(M = ~ f [u(L,t) - 6,(01 


See Figure 19.6. 



FIGURE 19.6 Diagram illustrating nonhomogeneous elastic BCs. 

This completes our discussion of the most common types of BCs associated 
with hyperbolic problems. In the next-few lessons, we will solve problems having 
BCs similar to these. 


NOTES 

1. Another BC not discussed in this lesson occurs when the vibrating string 
experiences a force at the ends proportional to the string velocity (and in 
the opposite direction). Here, we have the BC (at the left end) 

7w,(0./) = - pn,(0,r) 

2. A nonlinear elastic attachment at the left end of the string would be 

7n,(0,r) = (J>[n(0,/)] 
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where <)>(“) is an arbitrary function of u\ for example, 


Tu x (0,t) = -hu\0,t) 

says that the restoring force at the left end of the string is proportional to 
the cube of the displacement and not to u (as it was in the linear case with 
Hooke’s law). 

3. If a mass m is attached to the lower end of a longitudinally vibrating string, 
the BC would be 

mu„(L,/) = - ku x (L,t) + mg 


PROBLEMS 

1. From your intuition of the various kinds of BCs, draw a rough sketch of the 
solution to 


PDE u„ - c : n„ 0 < x < 1 0 < r < » 


BCs 

ICs 


u(0,t) = 0 
“(1,0 = sin t 
’«(x,0) = 0 
“,M) = 0 


for various values of time. 

2. Draw a rough sketch of the solution to 


0 < t < ao 
0 x ss 1 


PDE m„ = u xx 0 < x < 1 0 < t < =o 


BCs 

ICs 


u(0,t) = 0 

.“,( 1,0 = 0 


0 < t < » 


f u(x, 0) = sin (ttx/2) 

{“,(*, 0 ) = 0 0 


for various values of time. Can you guess the solution to this problem? 

3. What is the general nature of the BC 

“,(0,0 = f [“(0-0 - MO] 


when 

(a) h — * --a 

(b) h^0 
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OTHER READING 

Analysis and Solution of Partial Differential Equations by R. L. Street. Brooks/Cole, 
1973. An excellent text with an extensive chapter (Chapter 2) on initial and boundary 
conditions. 
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LESSON 20 

The Finite Vibrating String 
(Standing Waves) 


PURPOSE OF LESSON: To show how transverse vibrations of a finite 
string described by the IB VP 

PDE u„ = a 2 u xx 0 < x < L 0 < t < x 


ics ! u(x ’°) = /w 

l«,(*,0) = g(x) 


| can be found by the standard technique of separation of variables and to 
I show how the solution u(x,t) can be interpreted as the infinite sum 

«M = 2 Xn(x)T„(t) 

| of simple vibrations where the shape X„(x) of these fundamental vibrations 
! are 1 s ? lul,ons (eigenfunctions) of a certain Sturm-Liouville boundary-value 
problem. 


6o far, we have studied the wave equation u„ = c 2 u xx for the unbounded domain 
* < a- c oc and have found (D’Alembert’s solution) solutions to be certain 
traveling waves (moving in opposite directions). When we studv the same wave 
equation in a bounded region of space 0 < a < L, we find that the waves no 
longer appear to be moving due to their repeated interaction with the boundaries 
and. in fact, often appear to be what are known as standing waves. For instance 
consider what happens when a guitar string (fixed at both ends a = O.L) de- 
scribed by the simple hyperbolic IB VP 

PDE u„ = a 2 u xx 0 < a < L 0 < t < x 
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AfjMTjl/) « third standing wave 


FIGURE 20.1 Three typical standing waves X[x)T(f). 

If we knew the shapes X„(x) of these standing waves and how each one of them 
vibrated T n (t), then all we would have to do to find the solution of the vibrating 
guit^ptring is sum the simple vibrations X n (x)T n (t) 

u(x,t) - 2 cJC n (x)Ut) 

in such a way (find the coefficients cj that the sum agrees with the ICs u(x 0 ) 
= fix), U,(x, 0) = g(x) when t = 0 . 1 ’ ' 

We will now solve the guitar-string problem by the method of separation of 
vanables. 


lfr!ng rC,ti0n " 0f " Varlab,eS So,utlon to the Finite Vibrating 

To solve the IBVP 
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PDE 


0 <x < L 0 <t< 


ICs 0 x L 

L«.(jf.O) = g(x) 

we start by seeking standing-wave solutions to the PDE; that is, solutions of the 
form 


Substituting this expression into the 
us the two ODEs 


u(x,t) = X(x)T(t) 

d the wave equation and separating variables gives 


r - a 2 \r = o 

X' - \X = 0 

where the constant X. can now be any number -» < \ < so. 

Investigating the solutions of these two ODEs for all different values of \ 
yields the diagram in Figure 20.2. 



FIGURE 20.2 Standing-wave solutions for different values of X. 

The idea now is to prune away all those standing waves that either are unbounded 
as t -* co or else yield only the zero solution when substituted into the BCs u(0,t) 
- u(L,t) = 0. It will be left as an exercise for the reader to verify.. that only 
negative values of X give feasible (nonzero and bounded) solutions. Hence, our 
goal is to find the constants A, B, C, and D and the negative separation constant 
X so that the expression 

(20.2) u(x,t) = [C sin (px) + D cos (P*)][,4 sin (apt) + B cos (apt)] 
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satisfies the BCs. This will give us the collection of fundamental vibrations of 
the string, and the final goal will then be to sum them (the sum will still satisfy 
the PDE and the BC). so that the sum agrees with the IC when t = 0. 
Plugging (20.2) into u(O.t) = u(L.l) = 0 gives 

i/(0. t) = A'(0 )T(t) = D[A sin (apr) + B cos (a(Jf)] = 0 4> D = 0 
( 20 . 3 ) u(L.t) = X(L)TU) 

= C sin (PL)[/T sin (aP/) 

+ B cos (apt)] = 0 4- sin (pL) = 0 

In other words, the separation constant P (we can forget about X and find P) 
must satisfy sin (P L) = 0 or 

P" = T " = 


Since any sum of these vibrations is also a solution to the PDE and BCs (since 
the PDE and BCs are linear and homogeneous), we add them together in such 
a way that the resulting sum also agrees with the ICs. This will then be the 
solution to our problem. Substituting the sum 

■ u(x.r) = V s in (nvx/L)[a„ sin (n-nat/L) + />„ cos (n-nat/L)] 

j into the ICs 

u(*.0) = f(x) , 

j u,(j:, 0) = gU) 

| gives the two equations 


Note that if we choose C = 0 in the second equation of (20.3), we would get 
X(x)T(t) = 0. Hence , we have now found a sequence of simple vibrations (which 
we subscript with n) 

(20.4) u n(x,t) = X n (x)T„{t) = sin («iu/L)[a„ sin ( n-nat/L ) + b„ cos (nrraf/L)) 
n = 1, 2, 3, . . . 


u n (x,t) = R„ sin ( mtxIL ) cos [mra(f - 8 n )lL] 

(where the constants a n . b„, R„, and 8„ are arbitrary) all of which satisfy the 
wave equation and the BCs. The reader should be able to see that this sequence 
of functions constitutes a family of standing waves (which have the property that 
each point on the wave vibrates with the same frequency) whose shapes look 
like Figure 20.3. 





FIGURE 20.3 Standing waves u n {x,t) = X n [x)TM 

156 Hyperbolic-Type Problems • . 


2) b„ sin (n-nx/L) = f(x) 

2 a„(muxlL) sin (mrx/L) = g(jr) 
and using the orthogonality condition 

J o sin ( mitx/L ) sin {n-nx/L) dx = [ 

we can find the coefficients a„ and b„ 


(20.5) 


, = J q g(x) sin ( n-nx/L ) dx 
, = j[ fix) sin (n-nx/L) ax 



So we’re done, the solution is 


( 20 . 6 ) 


U C*.() - X s * n (mtx/L)[a n sin ( n-nat/L ) + b„ cos (n-nat/L)] 


where the coefficients a„ and b n are given by (20.5). This completes the problem, 
but before we close, we will make a few' useful observations. 
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NOTES 


1. If the initial velocity of the string is zero, then the solution (20.6) takes the 
form 


«(*»0 = 2 b n sin (n-nx/L) cos (n-nat/L) 

and has the following interpretation. Suppose we break the initial string 
position 

«(*.0) = fix) 

into simple sine components 

fix) = 2 sin ( mrxIL ) 

and let each sine term vibrate on its own according to 

u„(x,t) = b„ sin injrx/L) cos ( n-nat/L ) 

(this is a fundamental vibration). If we now add each individual vibration 
of this type, we will get the solution to our problem. For example, suppose 
our initial string position f(x) is 

fix) = sin (ttxIL) + 0.5 sin (3-rrx/L) + 0.25 sin (5-nxlL) 

The overall response to this IC would then be the sum of the responses to 
each term; that is, 

u(x,t) = sin (ttx/L) cos (-nat/L) + 0.5 sin (3 it x/L) cos (lirat/L) 

+ 0.25'sin' (5-nxlL) cos (5iTar/Z.) — - 

2. The n-th term in the solution (20.6) 

sin (mrxIL) [a n sin ( mratlL ) + b n cos ( n-nat/L )] 

is called the /i-th mode of vibration or the n-th harmonic. By using a trigono- 
metric identity, we can write this harmonic as 

R„ sin ( mrx/L ) cos [nua(( - 5J/Z.] 

where R„ and 8„ are the new arbitrary constants (amplitude and phase angle). 
This new form of the n-th mode is more useful for analyzing the vibrations. 
Note that the frequency tu„ (rad/sec) of the n-th mode is 


mra mr IT 

U>n ~ ~ ~L\J~p 

(T,p are tension and density of the string, respectively) 

Note, too, that this frequency is n times the fundamental frequency (n = 1). 
The property that all sound frequencies are multiples of a basic one is not 
shared by all types of vibrations. This has something to do with the pleasing 
sound of a violin or guitar string in contrast to a drumhead, where the 
higher-order frequencies are not multiple frequencies of the fundamental 
one. 

PROBLEMS 


1. Find the solution to the vibrating-string problem (20.1) if the ICs are given 
by 

u(x,0) = sin (ir x/L) + 0.5 sin (3ir xlL) 
u,(x,0) = 0 

Graph this solution for various values of time. Is the solution periodic in 
time? What is the period? 

2. What is the solution of the vibrating-string problem (20.1) if the ICs are 

u(x,0) = 0 
u,(x,0) = sin (3ir x/L) 

What does the graph of the solution look like for various values of time? 

3. Show that for X > 0 in Figure 20.2, the solutions X(x)T(t) are either un- 
bounded or zero. 

4. What is the solution of the vibrating-string problem if the ICs are 

u(x,0) = sin (3 trx/L) 
m,(x, 0) = (3WI) sin ( 3-nxlL ) 

5. A guitar string of length L = 1 is pulled upward at the middle so that it 
reaches height h. Assuming the position of the string is initially 
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what is the subsequent motion of the string if it is suddenly released? 
Solve the damped vibrating-string problem 

. PDE u„ = crn,, - $u, 0 < x < 1 0 < t < *■ 


I u(x,0) = t\x) 

l« r U,0) = 0 


Does the solution seem reasonable 11 Does it satisfv the above PDE, BCs. 
and ICs? 

How would you solve the nonhomogeneous PDE with given boundary and 
initial conditions 



OTHER READING 

Advanced Engineering Mathematics by C. Wylie. McGraw-Hill, -1970.. A very readable 
text that contains many interesting examples; see in particular Chapter 7. 


vpiii. 
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LESSON 21 

The Vibrating Beam (Fourth-Order 
PDE) 

PURPOSE OF LESSON: To illustrate how higher-order PDEs come 
about in the study of vibrating-beam problems and to solve the problem 
of a vibrating beam with simply supported ends bv separation of variables. 

It is also pointed out how the vibrations of the beam compare with the 
vibrations of the violin string. . 



The major difference between the transverse vibrations of a violin string and 
the transverse vibrations of a thin beam is that the beam offers resistance to 
bending. Without going into the mechanics of thin beams, we can show' that this 
resistance is responsible for changing the wave equation to the fourth-order 
beam equation 

(21.1) u„ = - cru,,„ 

where 

a 2 = K/ p 

K = rigidity constant (the larger K. the more rigid the beam and the faster 
the vibrations) 

P = linear density of the beam (mass/unit length). 

The derivation of this equation can be found in reference 1 of Other Reading. 
Since this is the first time the reader has seen an application of PDEs higher 
than second order in this text, it will be useful to solve a typical vibrating-beam 
problem. Later, we will talk about other types of beam problems. 
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The Simply Supported Beam 

Consider the small vibrations of a thin beam whose ends are simply fastened to 
two foundations. By “simply fastened,” we mean that the ends of the beam are 
held stationary, but the slopes at the end points can move (the beam is held by 
a pin-type arrangement, Figure 21.1). 


a(0.f)»0 

«„(0. f) =0 

FIGURE 21.1 A simply supported beam. 

It seems clear that the BCs at the ends of the beam should be 



but what isn’t so obvious is that the two BCs 


**-( 0 , 0 - 0 . 

«„(i,0 = o 

also hold at the two ends. Using the theory of thin beams (see reference 1 of 
Other Reading), we can show that the bending moment of the beam is repre - 
sented by u„ and alimply fastened beam should have zero moments at the end 
polHlsrHencef the vibrating beam in Figure 21.1 can be described by the IB VP 
(a is set equal to one for simplicity) 


(21.2) BCs 


u(0,r) = 0 

= 0 

u(l,t) = 0 

(1,/) = 0 


0 < t < 00 


ICs 


**(*.0) = /to 

**,(*.0) = g(x) 


0 


To solve this problem, we use the separation of variables method and look for 
arbitrary periodic solutions; that is, vibrations of the form 
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(21.3) 


u(x,t) = X(x)[A sin (tor) + B cos (tor)] 

Note that by choosing the solution in the form (21.3), we are essentially saying 
that the separation' constant in the separation-of-variables method has been 
chosen to be negative. 

We now substitute equation (21.3) into the beam equation to get the ODE 
in X(x). 

X" - <o J X = 0 

which has the general solution 

X{x) - C cos V<*x + D sin \fiox + E cosh V^x + F sinh VoLr 

To find the constants C, D, E, and F, we substitute this expression into the BCs, 
giving 

u(0,r) - 0 => *(0)T(t) « 0 =*> *(0) = 0 => C + E 

uJO ,t) « 0 A*(0) T( t) = 0 X'(0) = 0 => - C 

u (l )f ) = 0 D sin Vai + F sinh Vw = 0 
u„(l,r) = 0 4> - O sin Vw + Fsinh Vw = 0 

From these last two equations, we arrive at the expressions -**** - — - 

F sinh n/u = 0 
D sin Vw = 0 

from which we can conclude 

- - F = 0 . . 

sin Voj = 0 ^ w = (m r) J n = 1,2,... 

In other words, the natural frequencies of the simply supported beam are 

= (mr) J 

and the fundamental solutions u„ (solutions of the PDE and BCs) are 

u„(x,t) = X„(x)T„{i) = [a„ sin (mt) 1 ! -r b„ :os (nttlVl sin initx) 

Now, since the PDE and BCs are linear and homogeneous, we can conclude 
that the sum 
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also satisfies the PDE and BCs. Hence, all that remains to do is choose the 
constants a,, and b„ in such a wav that the ICs are satisfied. Substitutine equation 

(21.4) into the ICs gives us 

mU'.O) = f(x) = X b„ sin («m) 

(21.5) 

u,(x.O) = g(x) = 2 ("t) 2 ", sin (nm) 

and using the fact that the family {sin (nm)} is orthogonal on the interval (0,1] 
gives us 


( 21 . 6 ) 


Hence, the solution is given by (21.4). and a„ and b„ are given by (21.6). 

In order for the reader to understand this problem, we, present a simple 
example. 

Sample Vibrating Beam 

Consider the simply supported beam shown in Figure 21.2 with ICs 

u(a.O) = sin (m) + 0.5 sin (3m) 

u,(*.0) = 0 


FIGURE 21.2 Simple vibrations of a simply supported beam. 





164 Hyperbolic-Type Problems 


We could find the solution by substituting the values of /(.v ) and g(x) into equation 
(<-1.6), but it seems easier to look at equations (21.5) and simplv make the 
observation that 

a„ = 0 for all n = 1 , 2. . . . 

6 , = 1 
b, = 0 
by =0.5 

b„ = 0 n = 4. 5. . . . 

Hence, the solution is 

u(x,t) = cos (ir 3 r) sin (m) + 0.5 cos (9irr) sin (3m). 

It is interesting to see how this solution compares with the vibrating string with 
the same ICs. If we look back to Lesson 20, we find that the solution to the 
vibrating-string problem is given by 

u(x,t) = cos (rrt) sin (m) + 0.5 cos (3trr) sin (3m) 

In other words, the vibrating beam vibrates at higher frequencies than does the 
vibrating string. It would be interesting forthe reader to imagine just how each 
of these vibrations looks. Note, however, that both higher frequencies are integer 
multiples of the fundamental frequencies. 

NOTES 

1. Beams are generally fastened in one of three ways 

(a) Free (unfastened) 

(b) Simply fastened 

(c) Rigidly fastened 

Some sketches are given in Figure 21.3 along with their BCs. 

2. Another important vibrating-beam problem is the cantilever-beam problem 
shown in Figure 21.3. The solution to this vibrating beam is not the usual 
sum of products of sines and cosines, but due to the nonstandard BCs, 

u(0,r) = 0 
u,(0,0 = 0 
MU) = 0 
MU) = 0 

we arrive at the more complicated solution 
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(c) Beam rigidly fastened at left; simply fastened at right. 

FIGURE 21.3o-21.3c Typical beam problems. 

u(x,t) = 2 X n (x) [a n sin (a >„t) + b„COs(a)„r)]_ 

where the eigenfunctions (basic shapes of vibrations) are given by linear 
combinations of sines, cosines, hyperbolic sines, and hyperbolic cosines. 
The solution to this problem can be found in reference 3 of Other Reading. 

PROBLEMS 

1. Solve the cantilever-beam problem 

PDE u„ + u xxxx = 0 0 < x < 1 0 < r < = 
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HINT Although the eigenfunctions *„(*) i" this problem are not the usual 
sine functions, we can still use the Siurm-Liouville theory to say that the 
eigenfunctions are orthogonal on [0,1]. 

2. What is the solution to the simply supported beam (at both ends) with ICs 

u(x,0) = sin (to) o « * « 1 
u,(x,0) = sin (to) 


3. What is the solution to the simply supported beam problem with ICs 


u(x,0) = 1 - 
u,(x,0) = 0 


.0 * =£ 1 


4. Let the left end (x = 0) of a beam be rigidly fastened to a wall and let the 
right end (x = 1) be simply fastened according to the BCs shown m Figure 
21.3. Solve the beam problem with these BCs and tell how to find the natural 
freauencies of vibration of this beam. Knowing the natural frequencies of 
the beam is important, since various kinds of inputs of the same frequency 
can give rise to resonance. 


OTHER READING 

. 1 .- Analysis-andSolution-of Partial Differential Equations by R. L. Street. Brooks-Cole, 1973. 
Chapter 5 contains a derivation of' the vibrating-beam problem. 

2. Mathemaiical Methods in Physics and Engineerin'; by J. W. Dettman. McGraw-Hill, 1962; 
Dover, 1988. This text contains a large section on the Sturm-Liouville problem. 

3. Advanced Mathematics for Engineers by C. R. Wylie. McGraw-Hill, 1961 . This book 
contains the solution of the cantilever-beam problem. 
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LESSON 22 

Dimensionless Problems 


| PURPOSE OF LESSON: To show how boundary-value problems. 

initial-value problems, and other types of physical models can be written 
I in dimensionless form. In this form, we replace the original variables of 
! the problem by new dimensionless ones (they have no units). 

By writing a problem in dimensionless form, specific equations from 
physical, chemistry, biology, and economics that originally look different 
become one and the same. For this reason, the mathematical study of 
PDEs generally doesn’t concern itself with the physical parameters. in the - 
equations. It is up to the chemist, physicist, or biologist to transform his 
or her equation into those in the textbook. 


The basic idea behind dimensional analysis is that by introducing new (dimen- 
sionless) variables in a problem, the problem becomes purely mathematical and 
contains none of the physical constants that originally characterized it. In this 
way, many different equations in physics, biology, engineering, and chemistry ' 
that contain special nuances via physical parameters are all, transformed into the 
same simple form (Figure 22.1). 



FIGURE 22.1 Several problems converted to one basic nondimensional form. 
To see how this process works, let’s consider a simple example. 

Converting a Diffusion Problem to Dimensionless Form 

Suppose we start with the initial-boundary-value problem where the temperature 
is initially u(x. 0) = sin (tt x/L). but the boundaries are then instantly raised to 
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0 ulx. 0) - sin tnx/L) 


FIGURE 22.2 Domain for the heat-flow problem, 

Our goal is to change problem (22.1) to a new equivalent formulation that has 
the properties 

1. No physical parameters (like a) in the new equation 

2. The initial and boundary conditions are simpler 

To do this, we will introduce three new dimensionless variables U, and t that 
take the place of u, x, and t, respectively 

u * U (dimensionless temperature) 

x > (j (dimensionless length) 

r * t (dimensionless time) 

We carry out these three transformations one at a time for simplicity. 


Transforming the Dependent Variable u -» U 

We define U(x,t) by 


U(x,t) = 


u(x.t) - r, 

-wr- 


it's clear that this new temperature U(x.t) has no units, since we are dividing 
°C by °C. It's also clear why we chose U(x,t). You can see that the new BCs for 
U(x.t) at x - 0 and L will be U(0,t) = 0 and U(L.t) = 1. In fact, let's examine 
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the new transformed problem for U(x,t). With a little effort, we can see that the 
original problem (22.1) has now been transformed into 


( 22 . 2 ) 


PDE 

BCs 

IC 


U, = ort/„ 
U(0,t) = 0 
U(L.t) = 1 


0<x < L 

0 < t < x 


U(x,0) = 


sin (irx/L) - T , 
T 2 - r, 


0 < r < =c 

0 ^ * =s L 


If we wished, we could stop here and solve for U(x,t) and then solve for u(x t) 
from the formula 


u(*,f) = T, + (7j - TJUix.t) 

Let’s continue, however, and transform the independent variables x and t. Next 
we transform the space variable x. 


Transforming the Space Variable x-* $ 

It seems obvious how we should pick the dimensionless-space variable £. Since 
0 x L, we pick 



We are now two-thirds of the way toward our goal. The final step is to introduce 
a dimensionless timet, so that the constant [a/L] 2 disappears from the differential 
equation. 
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Transforming the Time Variable t -* t 

How to introduce a new dimensionless time isn’t quite so clear as choosing the 
first two variables. However, since our goal is to eliminate the constant [a/L] 2 
from the PDE, we proceed as follows: 

1. Try a transformation of the form t = ct, where c is an unknown constant 

2. Compute u, = u r t, - cu T 

3. Substitute this derivative into the PDE to obtain 

cu , = [a/L] 2 u u 

and, hence, pick c = [a/L] 2 . This gives us our new time 
t = [a/L] 2 r 

Using this transformation on our previous problem (22.3), we have the com- 
pletely dimensionless problem ( U , and t) 

PDE U, - U n 0 < § < 1 0 < t < 00 

(22.4) BCs {$?;;]!? »<■'<" 

IC u(i 0) = 4>(5) 

sin (ir?) - T, 
where 4>(0 = — ^ _ j. ' — 

This new dimensionless problem has the following properties: 

1. No parameters in the PDE 
2: Simple BCs 

3. IC hasn’t essentially been changed (still a known function) 

4. Problem-is- simpler and more compact than the original one 

The solution, to this problem can be found once and for all, so if a scientist 
transformed his or her original problem (22.1) to this dimensionless one (22.4) 
and found the answer U(%, t) in a textbook or research journal, he or she could 
find the solution u(x,t) to the original problem (22.1) by merely computing 

u{x,t) = T, + (T 2 - T x )U{xlL, a-t /L 2 ) 

This completes our discussion of transforming problems into dimensionless form. 
There aren’t any set rules on how the new variables are defined; we more or 
less have to use physical intuition and try various possibilities. 

We finish this lesson with a simple example of how to transform into dimen- 
sionless form, solve the new problem, and transform back to the original lab- 
oratory coordinates. 
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Example of Transforming a Hyperbolic Problem to 
Dimensionless Form 

Consider the vibrating siring 

PDE u„ = a 2 k„ 0 <x< L 0 < r < * 


2. Dimensional analysis allows mathematicians to work with P.DEs without 
bothering with a lot of parameters and constants that are not relevant to 
the mathematical analysis. 

3. It's not always necessary to transform all the variables into dimensionless 
form: sometimes only one or two have to be transformed. 


!;; - 5i BC ' \u(Lj) = 0 

Ir , fw(A,0) = sin (■nx/L) - 0.5 sin (3iu/L) , , 

= 0 0*x*L 

By transforming the independent variables (no need to transform u) into to new 
ones 


e get the new problem 


(22.6) BCs 


0 < 7 <-=< 


«(1,t) = 0 

/ m(€. 0) = sin (ir£) + 0.5 sin (3ir£) n , . 

1CS = 0 0«.^1 

which has the solution 

u{t. t) = cos (tt 7 ) sin (tt^) + 0.5 cos (3 it 7) sin (3 t r$) 


PROBLEMS 


1. Transform the vibrating string problem (22.5) into dimensionless form (22.6) 
by means of the transformations 


5 = xlL 7 = [a IL) t 

2. Find the dimensionless formulation for the problem 


and 7 

= 

PDE 

U, = 0 l 2 u xx 

0 < X < L 

0 < | < 1 

0<7<* ; 

BCs 

/«(0,0 = T t 
1«(M = 0 

0 

A 

A 

8 



IC 

«(*,o) = r. 

.0 

/A 

/A 

t- 


3. Transform problem (22.1) into (22.2) by means of the change of variable 


U{x,t) = 


«*(*.<) - T, 


4. Can you think of a physical reason why the new time variable 7 = at would 
eliminate the parameter a 2 in the wave equation 


If we now transform back to coordinates x and r. we have the solution to our 
original problem (22.5) 

u(x.t) = cos (thxi/L) sin (trx/L) + 0.5 cos (3-nal/L) sin (3vx/L) 


NOTES 

1. Dimensional analysis is especially important in numerical analysis, since 
most computer programs are written in a general form and don’t solve 
problems with a great many physical parameters. Anyone using these pro- 
grams must transform the problem into the form accepted by the program, 
solve the transformed problem, and then transform the numerical results 
back to his or her own coordinates. 


u„ = a 2 i<„. 

Remember what a means in terms of the velocity of the wave; intuition 
plays a major role in finding the most desirable new coordinates. • 

5. How could you pick a new space variable £ so that v is eliminated in the 
equation 

u, + vu, = 0 


OTHER READING 

Dimensional Analysis and Theory of Models by H. L. Langhaar. John Wiley & Sons. 
1951. A well-written book that contains many more aspects of dimensional analysis than 
does this lesson. 
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LESSON 23 


Classification of PDEs (Canonical 
Form of the Hyperbolic Equation) 


PURPOSE OF LESSON: To show how the second-order linear PDE 
in two independent variables 

Au xx + Bu xy + Cu yy + Du x + Eu y + Fu = G 

{A, B, C, D, E, F, and G are functions of x and y and could be constants) 
can be categorized as either 

1. Hyperbolic (if B 2 - 4AC > 0) ^ 

2. Parabolic (if B 2 - 4 AC = 0) 

3. Elliptic (if B 2 - 4 AC < 0) 

and to show how new coordinates £ = £(*,y) and i\ = T|(*>y) are introduced 
(in place of x and y) that simplify the equation. When this PDE is written 
in terms of the new coordinates £ and -n, it takes on one of three canonical 
forms (depending on whether B 2 - 4 AC is positive, zero, or negative, 
respectively) 

( u n ~ = T t* u ’ U( ’ ( two canonical forms for\ 

\ the hyperbolic equation / 

<Ki n. «0 V -- 

/ the canonical form for\ 

2. u„„ = ^(i *n. M > u t- U J \^the parabolic equation/ 

/ the canonical form for \ 

3. u u + = <P(& *n> u > u v ^ t he elliptic equation ) 

where <t> is and 'P are functions of the first derivatives and u ,, the 
dependent variable u, and the new independent variables £ and n- The 
exact functions <t> and 'P depend, of course, on the original equation. 
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The reader may think offhand that a chapter dealing with the classification of 
PDEs should occur at the beginning of the book; this is probably true, and many 
books do begin by discussing this subject. However, it is true, too, that most 
students do not get' very excited about studying something they know nothing 
about, and for that reason, we have waited until now to introduce the topic of 
classifying PDEs. 

The purpose here is to classify the PDE 
(23.1) Au xx + Bu xy + Cu yy + Du x + Eu y + Fu = G 

(where A, B, C, D, E, F, and G are, in general, functions of x and y) as 

1. Hyperbolic at a point (jc 0 ,>^ 0 ) if B 2 {x 0 ,y„) - 4A{x a ,y t )C{x n ,y n ) > 0. 

2. Parabolic at a point (j^yo) if B 2 (x, u y„) - 4A(x B ,y„)C(x„,y„) = 0. 

3. Elliptic at a point ( x„,y 0 ) if B 2 (x„,y a ) - 4 A(x„,y n )C(x,„y„) < 0. 

and depending on which is true, to transform the equation into a corresponding 
canonical (simple) form. In order for the reader to understand the classification 
scheme, we first give four examples of hyperbolic, parabolic, and elliptic equa- 
tions. 


Examples of Hyperbolic, Parabolic, and Elliptic 
Equations* 

1. The heat equation u, = u xx is a second-order linear equation of the form 
(23.1) with coefficients 

A = 1 5 = 0 C = 0 D = 0 

E = -1 5=0 C = 0 

so B 2 - 4AC = 0 for all x and t; hence, the equation is parabolic for all 
x and t. Note that we have called the time variable y in the general 

equation'. In fact; we" would have gotten the same result if we called the 

x in the heat equation the y in the general equation and then called the 
time variable / the x in the general equation. 

2. The wave equation u„ = u xx is also of the form (23.1) with coefficients 

A = 1 5 = 0 C =-l D = £ = f= C = 0 

Hence, 5 2 - 4AC = 4 for all * and t, and the equation is hyperbolic for 
all * and t. 

" It should be pointed out that the examples are prototypes of the more general parabolic, 
hyperbolic, and elliptic equations and that the behavior of these examples characterizes 
much of the general situation. 
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3. The Laplace's equation - i/,, = 0 is elliptic for all x and y. since B 1 
- 4AC = -4 < (I. 

4. The linear equation xu x . - i,.. — sin .v with variable coefficients is also 
of the form (23. 1). but now B : -4 AC = -Ax. and. hence, the equation 

Elliptic for x > 0 
Parabolic lor x - (l 
Hyperbolic for .v < 0 

This example brings out the fact that equations with variable coefficients 
can change form in different regions of the domain. 

The reader should note, too, that whether equation (23.1) is hyperbolic, 
parabolic, or elliptic depends only on the coefficients of the second derivatives ; 
it has nothing to do with the first-derivative terms, the term in u. or the non- 
homogeneous term. 

We now come to the major portion of this lesson: rewriting hyperbolic equa- 
tions in their canonical form. It turns out that if an equation is hyperbolic (in a 
given region of space), then it is possible to introduce new coordinates £ and q 
(characteristic coordinates) in place of the original x and y. so that the equation 
takes on the simple form 

(23.2) u t „ = 4 >(S,t \,u,u f ,uj 

This equation contains only one second derivative tf {T) , while the function <t>(fj, 
q, u, u ( , m„) is some function of the new independent variables fj and q, the 
dependent variable u , and the first derivatives u v w„. The exact form of the ' 
function <1> depends, of course, on the original equations, and finding it, along 
with the new coordinates £ and q, is the object, of this lesson. 

The Canonical Form of the Hyperbolic Equation 

We start with the general PDE 

(23.3) Au xx 4- Bu xy + Cu„ - Du,. + Eu y + Fu = G 

where B : - 4,4 C > 0 in our domain of interest. The object here is to introduce 
new coordinates 

£ = t(x.y) 

T) = q(A-.y) 

so that the general PDE contains only one second derivative u tn (it turns out 
that if we tried to transform a hyperbolic equation into the elliptic or parabolic 
canonical forms, the technique wouldn't work). 

First of all. we compute the partial derivatives .. 
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(.23.4) 


«. = ‘hL + "„n. 

«, = + w„q. 

= ««£ + 2w t ^,q, + H„„ q; + u£„. 4- q,, 

u„ = h k £,£, + » t ,,(£,q, -i- £,q,)' + «„.,q,q., + + «„q,, 

M.v, = + 2« 4 „£ v q,. + u„„q; + n f £,, 4- n„q, v 

Substituting these values into the original equation (23.3). we have 

(23.5) Au k + Bu t „ + Cu^ + Du k + Eu ^ 4 - Fu = G 


A = Ag + BU, + Ci; 

B = 2A §,q, + fl(£,q v + |,.qj + 2C£,.q,. 

. . C At]l-+ Sq A q, + CqJ 

(23.6) D = Ai xx + ££,,.’ + C$,v + DL + £4, 

E — At) xx 4- Br\ xy 4- Cq rJ . + Dr\ x 4- £q,. 

F = F 

C = C 

These calculations, although mathematically straightforward, are quite cumber- 
some. The reader will get a chance to carry them out in the problem set. 

The next step in our process is to set the coefficients A and C in equation 
(23.5) equal to zero and solve for the transformation £ = £(x,y), q = q(x,y). 
This will give us the coordinates that reduce the original PDE to canonical form; 
so, setting 

A = Ag + BUy + Ci = 0 
C = At]! + flq,q,. 4- Cqj 1 . = 0 

we then rewrite these two equations in the form 

A{Uiy ) 2 + *[i/y + c = 0 

A ^[VqJ* ,+ 5[Vq r ] 4- C = 0 

Solving these equations for [£,/£,,] and [Vq,.], we find 



(characteristic equations) 


Classification of PDEs (Canonical Form of the Hyperbolic Equation) 177 


Note that [£/?,] and [q/q„] eac h have tw0 solutions to their quadratic equations, 

but we only have to find one solution for each in order for A and C to be zero. 
The only restriction is that we don’t pick the same roots, or else we will end up 
with the two coordinates the same. 

We have now reduced the problem to finding the two functions fj(.r,y) and 
q(x,.y) so that their ratio [&/H,,] and satisfy equation (23.7). Finding func- 

tions satisfying these conditions is really quite easy once we look for a few 
moments at Figure 23.1. 



FIGURE 23.1 Characteristic curves £(x,y) = c and q(x,y) = c. 

To understand how we find f; and q from this figure, consider the simple equation 
u„ - 4 u„ + u x m 0 B 2 - 4 AC = 16 > 0 
whose characteristic equations are 



To find (j and q, we first solve for y (integrating), getting 
y = -2 x + c t 

y = 2x + Cj 

and, hence, to find f; and q, we solve for the constants c, and c,, leaving them 
on the right-hand side of the equations while moving everything else to the left. 
The functions of .t and y on the left are fj and q; that is, 

€ = y + 2* = c, 
q = y - 2x = c, 
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It is clear that the functions £ and q satisfy the above characteristic equa- 
tions. These particular new coordinates are drawn in Figure 23.2. This com- 
pletes the discussion on how to find the new coordinates; the last step is to find 
the new equation. 



FIGURE 23.2 The new characteristic coordinates for u„ - 4u„ + u, = 0. 

The last part is very easy: All we must do to find the canonical equation is 
take the new coordinates i|(*,.y) and q(Ar,y) and substitute them into the equation 

Au h + Bu to + + £>w { + + ~Fu = G 

where A, B, C, D, E, F, and G are given by (23.6). 

Before we complete this lesson, let’s apply the general procedure to see how 
it works in a specific example. 

Rewriting the Hyperbolic Equation - x 2 u yy = 0 in 
Canonical Form 

Suppose we start with the equation 

y u ' a - *x,'= y '"~x > o " y > o 

which is a hyperbolic equation in the first quadrant. We consider the problem 
of finding new coordinates that will change the original equation to canonical 
form for x and y in the first quadrant. 

STEP 1 Solve the two characteristic equations 

(remember, this step is equivalent 
to setting A = C = 0) 

Classification of PDEs (Canonical Form of the Hyperbolic Equation) 179 


dv 5 r v8 — *M C 
J~x = 2 A 

cly _ B - VF - 4AC x 

dx~ 2A y 



01^1 rnl t»|Ol Caixi 


Integrating: these two equations by the ODE technique of separating variables 
gives the implicit relationship (we can't actually solve for y explicitly in terms 
of x here) 

y~ - X' = constant 

y : j_ v : _ ct)nS ( an t 


£ = y 2 - A ' 2 

t i = r + * 2 

These two new coordinates are drawn in Figure 23.3. 


FIGURE 23.3 New characteristic coordinates. 

This gives us the new coordinates; in order to find the new equation, we compute 

= 0 this must be true; we set it equal to zero and solved for £ and i) 

= 2/4 £,t), + £(£,t) v + 1^) + 2C£ > .t| } . = - 16aV 
= 0 same here; we set it equal to zero 

= + Bt„, + C£, v + £>£, + ££,. = — 2(x 2 + y 2 ) 

- /4ti„ + Br\ xv + Ct| vv + Dt\ x + £ti,. = 2 (v 2 - x 2 ) 

= F = 0 • 

= G = 0 

and substitute them into the equation 

Au ti + Bu + Cu „„ + Du i + Eu v + Fu = G 

to get 



STEP 2 Finally, solving for x and y in terms of £ and t), we get 
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(23. S] 


s the end of the line: we now kn< 
?w equation. 


1 . The general hyperbolic equation actually has two canonical forms: the other 
one can be found by making yet another transformation 


a = “(Son) = 4 + f] 

3 = 3(4.11) = 4-ii 


and rewriting the first canonical for 
equation (23.8) gives 


i terms of a and 3. Doing this for 


+ «bP { = u a + «„ 

+ h bPt, = tr„ _ Wp 
+ U ap3„ + W Bo“„ + “bbP-, = “o a 


If we wish, we could solve for the a and 3 coordinates in terms of the 
original x and y; in other words, 

a = £ + -t\ = (y 2 - x 2 ) + (y : + a: 2 ) = 2y : 

3 - 4 - H = (y 2 ~ x 2 ) - (y 2 + a 2 ) = -lr 2 

One question the reader may ask is why someone would be interested in 
classifying and transforming a PDE into canonical form. 

(a) The three major classifications of linear PDEs as hyperbolic, para- 
bolic. and elliptic equations essentially classify physical problems 
into three basic physical types: wave propagation, diffusion, and 
steady-state problems. The mathematical solutions of these three 
types of equations are quite different. 

(b) Much of the theoretical work on the properties of solutions to hy- 
perbolic problems assumes the equation has been written in ca- 
nonical form. In other words, it's the equation 
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that is studied. If we have an equation and want to study properties 
of the solution, we must convert it to canonical form and use existing 
results. 

(c) Many computer programs have been written to find the numerical 
solution of the canonical hyperbolic equation. The function t). 
u, u v «„) is fed into the computer in the form of a subroutine so it 
is necessary to convert the PDE to canonical form before starting. 
After finding the solution in terms of the new coordinates, we can 
always convert back to the original coordinates. 

PROBLEMS 


1. State whether the folowing PDEs are hyperbolic, parabolic, or elliptic: 

(a) «„ - « rv = 0 

(b) »„ = u xx + u x + hit 

(c) u„ + 3u yy = sin x 

(d) u xx + u yy — f(x,y) 

(e) u rr + ~ r u, + = /(r,9) 

2. Verify equations (23.4);. (23:5)v;and (23.6) in the lesson. 

3. Verify that the equation , 

3u xx + 7 u xy + 2 - 0 

is hyperbolic for all x and y and find the new characteristic coordinates . . 

4. Continue with problem 3 by finding the new canonical equation 

= ^(i t\. U. uj 

5. Continue with problem 4 by finding the alternative canonical form 

- “03 = not. 0. u, u a , u 0 ) 

6. Find the new characteristic coordinates for 

u xx + 4u, v = 0 

Solve the transformed equation in the new coordinate system and then 
transform back to the original coordinates to find the solution to the original 
problem. 


182 Hyperbolic-Type Problems 


LESSON 24 


The Wave Equation in Two and 
Three Dimensions (Free Space) 


PURPOSE OF LESSON: To solve the initial-value problem 


PDE «„ = c 2 [u„ + u yy + u„] 


ICs 


u(x,y,z, 0) = 
u,(x,y,z, 0) = 


_ x < X < * 
-*<.V < “ 
< Z < a 


in three dimensions and show how this solution satisfies Huygen’s principle. 
The method of descent is then used to solve the corresponding problem 
in two dimensions 


PDE 

ICs 


u„ = + u yy ] 

u(x,y, 0) = <|>(x,y) 
M,(x,y,0) = tKx.y) 


0 < X < a 

°<y < 3 


It is then shown that the two-dimensional solution does not satisfy Huygen’s 
principle. Finally, the method of descent is used once more to show that 
the one-dimensional version of this problem has the D’Alembert solution 
(which we have seen before). 


Earlier, we discussed the infinite vibrating string with ICs and showed how it 
gave rise to the D’Alembert solution. The reader should realize that another 
application of the one-dimensional wave equation would be in describing plane 
waves in three dimensions. For instance, sound waves that are reasonably far from their 
source are essentially longitudinally vibrating plane waves and. hence, are described by 
this equation. The general situation is 

1. One-dimensional waves are called plane waves 

2. Two-dimensional waves are called cylindrical waves 

3. Three-dimensional waves are called spherical waves 
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in oilier words, the one-dimensional \va\c equaiion might describe cither plane 
waves in higher dimensions or else a one-dimensional vibrating string. The 
problem of this lesson is to generalize the D'Alembert solution to two and three 
dimensions. 



^ J g t|>(jc + ct sin 4> cos 6, y + ct sin <t> sin 6, 

z, + ct cos 4>) (ct) 3 sin <)> dd d<b 

The arguments of 4# range over the surface of the sphere as 0 and d> range from 
[0.2 tt] and [O.-rr], respectively (Figure 24.1). 
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FIGURE 24.1 Solution as the average of initial disturbances on a sphere. 

The interpretation of this solution is that the initial disturbance 4/ radiates out- 
ward spherically (-velocity c) at each point, so that after so many seconds, the 
point ( x,y,z ) will be influenced by those initial disturbances on a sphere (of 
radius ct) around that point (Figure 24.2). 



FIGURE 24.2 Initial disturbance 4/ propagating outward from each point. 

The actual value of the solution (24.3) would most likely have to be computed 
numerically on a computer for most initial disturbances. It might be interesting 
for the reader to try to evaluate this solution for a few simple functions t|). 
Now. to finish the problem. What about the other half; that is. 

(24.4) PDE u„ = c : V : w ( x.y,:)zR : ' 



This is easy: A famous theorem developed by Stokes says all we have to do to 
solve this problem is change the ICs to u = 0. u, = <b. and then differentiate 
this solution with respect to time. In other words, wc solve 
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(24.5) 


PDE 


u„ = c 1K 7 2 u 



to get « = /<}> and then differentiate with respect to time. This gives us the 
solution to problem (24.4) 

u.iw 

We can see how this works for the one-dimensional wave equation where the 
solution (D’Alembert’s solution) of (24.5) is 

u(x,t) = j^[_ a <f>(-y) 

Therefore, if we differentiate this equation (Leibnitz rule, problem 7), we get 
u,(x,t) = } [4>(* + «) + <)>(* - «)] 
which is the solution of (24.4). 

Knowing this, we now have the solution to our general three-dimensional 
problem 

PDE u„ = c^u (x,y,z)eR i 



It’s just 

where <t> and 4/ are the averages of the functions and 4> over the sphere of 
radius a centered at ( x,y,z ). 

This is known as Poisson’s formula for the free-wave equation in three di- 
mensions, and it is the three-dimensional generalization of the D'Alembert 
formula. The most important aspect of the Poisson formula is the fact that the 
two integrals in ib and ill are integrated over the surface of a sphere, which 
enables us to make the following important interpretation of the solution. When 
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time is r = r„ the solution u at (x.y.z) depends only on the initial disturbances 
d> and 4« on a sphere of radius cr, around (x.y.z) (Figure 24.3). 



FIGURE 24.3 Diagram showing how initial disturbances affect a point (x,y.z). 

Suppose now the initial disturbances 6 and 4i are zero except for a small sphere 
(see Figure 24.3). As time increases, the radius of the sphere around (*.y,z 
increases with velocity c. and so after u seconds, it will finally intersect the initial 
disturbance region; and, hence, u(x,y,z,t) becomes nonzero. For r, < t < the 
solution at (x.y.z) will be nonzero, since the sphere intersects the disturbance 
region, but when r = r„ the solution at (x,y,z) abruptly becomes zero again. In 
other words, the wave disturbance originating from the initial-disturbance region 
has a sharp trailing edge. This general principle is known as Huygen’s principle 
for three dimensions, and it is the reason why sound waves in three dimensions 
stimulate our ears but die off instanteously when the wave has passed. It turns 
out that waves always have sharp leading edges, but the trailing edges are sharp 
only in dimensions 3, 5, 7, . . . We already know from the D’Alembert solution 
that the initial disturbance 

. u(jr.O) = 4>W 

u,(3c.O)' - iRx) 

in one dimension does not have a sharp trailing edge [since the D’Alembert 
solution integrates from (x - ct) to (x + cr)]. . , 

We will now show that the Huygen’s principle does not apply to cylindrical 
waves. This situation occurs when a water wave originates from a point where 
the trailing edge of the wave is not sharp but gradually damps to zero. 


Two-Dimensional Wave Equation 

To solve the two-dimensional problem 
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PDE 


ir Jh(-V.v.O) - dx.v.v) 
| »,(.v.v.(l) =- i!i(.v. v) 


we merely let the initial disturbances <S and «• in the ihrcc-dimaisiona! problem 
depend on oni\ the two variables and v. Doing this, the threc-dimensiomd 
formula 


u = n!> - -jj [rd>] 


for u will describe cylindrical waves and. hence, give us the solution for the two- 
dimensional problem: this technique is called the method of descent. Carrying 
out the computations (which arc by no means trivial), we get 



This is the solution for the free-wave equation in two dimensions , and although 
we would probably have to evaluate it numerically, it has an interesting inter- 
pretation in terms of Huygen's principle. Note that in this solution/ the two 
integrals of the initial conditions <b and d/ are integrated over the interior of a 
circle (the key word is interior) with center at (x.v.z) and radius a. In other 
words, if we analyze what this means in a manner similar to the three-dimensional 
case, we see that initial disturbances give rise to sharp leading waves, but not 
to sharp trailing waves. Thus. Huygen s principle doesn't hold in two dimensions. 

Finally, if we assume the initial conditions d> and t|/ depend only on one 
variable, this gives rise to plane waves and. hence, the preceding equation de- 
scends one more dimension to the well-known D'Alembert solution 

u(xd) \ [6U + ct) 4- d>(.v - c/)] + ^ jf tl/(s) ds 

Again, carrying out the actual computation in the method of descent is nontrivial. 
Note in the D'Alembert solution, the initial position gives rise to sharp trailing 
edges, but the initial velocity does not. In other words, one dimension is a little 
unusual in that the initial position Satisfies Huygen's principle, but the initial 
velocity does not. We generally say here that Huygen's principle does not hold 
in one dimension. 


188 Hyperbolic-Type Problems 


NOTES 


The method ol descent wasn't illustrated in detail in this lesson, since we didn't 
show how the lower-dimensional integral could be constructed from the higher- 
dimensional one. The actual calculus can be found in reference 2 of Other 
Reading. The general idea is that the solutions of problems in higher-dimensional 
spaces can be used to find the solution to problems in lower-dimensional ones 
by assuming certain boundary and initial conditions are independent of certain 
variables. The reader should realize that this isn't the only problem to which 
the method of descent applies. 

PROBLEMS , 

1. Show that in one dimension, we can find the solution of 

PDE u„ = c : u„ - sc < a- < K 

. ir , f w(x.O) = 4 >(a) 

\u,(x,0) = 0 



PDE 

«„ = c-V-tq, (x.v)eR- 

ICs 

|«(x,0) = 0 r, 

u \ x 0) = 1 - r + >" * 1 

1 A ’ ’ |0 elsewhere 

5. (To be worked with problem 3.) What is the one-dimensional solution of 
the analogous plane wave problem 

PDE 

u„ = c 2 n „ - x < x < 3= 

ICs 

tei 0 ! 1 w *' 

l ’ } jo elsewhere 

6. What is the physical interpretation of why Huygen’s principle does not hold 
in two dimensions? 

7. Use Leibniz's rule 


’ ^ &0A + g'msi').') - mwo.i] 

to differentiate the integral 

Y c H * 

- with respect to t. 


OTHER READING 

.1.. Partial Differential Equations by P. Garbedian. John Wiley & Sons. 1964.. An ex- 


cellent account of Huygen's principle; the book is considerably more advanced than this 
lesson. 

2. Equations of Mathematical Physics by A. N. Tikhonov and A. A. Samarskii. Macmillan. 
1963; Dover, 1990. An excellent reference for problems in mathematical physics. 


LESSON 25 


The Finite Fourier Transforms (Sine 
and Cosine Transforms) 


PURPOSE OF LESSON: To introduce two new integral transforms 
(finite sine and cosine transforms) 


S„ = S[f\ = j- J n fix) sin (n-nxIL) dx 

(finite sine transform) 

C n = C[f\ - fix) cos (rntx/L) dx 

(finite cosine transform) 

fix) = £ S* sin (nvxIL) (inverse sine transform) 

fix) = y + S c n c °s instx/L) 

(inverse cosine transform) 


and to show how to solve boundary-value problems (particularly nonhomo- 
geneous ones) by means of these transforms. Earlier, we learned about 
the regular Fourier and Laplace transforms and how problems are solved 
by transforming partial differential equations into ODEs. The usual Fourier 
transform requires the variable being transformed to range from -“to 
x; hence, it is used to solve problems in free space (no boundaries). In 
..this lesson, we. show how to solve boundary value problems (with bound- 
aries) by transforming the bounded variables (first time we’ve done this). 


First, let’s forget the motivation; let’s just define the transforms, their inverses, 
and use them. We will talk about why they work later. In short, however, 
transform methods can be thought of as resolving the functions of the problem 
into their various frequencies — solving an entire spectrum ot problems tor each 
frequency and then adding up the results. 

We first start with a function f(x) defined on an interval [0. L\. The finite 
sine and cosine transforms of this function are defined by 
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Finite sim 

: tritnslorn; 

| 


fix) sin (n-.x'L) dx ; 

n = .1. 2. . . . i 

Finite cosi 

ine transform ' 

an = c, = =- 

[ f(x) cos (n-x'L) dx 
n = ('. ]'. . . 


The reader will note that these transforms do nothing more than transform a 
function into the Fourier sine and cosine coefficients. The inverse transforms 
of these transforms are the Fourier sine and cosine series 

Inverse sine transform 

Inverse cosine transform 

Note that the summation in the inverse cosine starts at n = 0. while the inverse 
sine starts at n = 1. 

Examples of the Sine Transform 

M ■ ' 0 - ■ * « 1 5 - ■ - 2 I' si " <"”> * - {JL ” 

See the graphs of /(a) and its transform in Figure 25.1. 

fix) s, = slil 



FIGURE 25.1 Graph of = 1 and its transform. 
The inverse transform would be 
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Do you know what the graph of this function would be outside the interval (().]]?■ 
Think about it. Note. too. that the sine transform of f(x) is a function defined 
only at the positive integers (that is. it is just a sequence of numbers). In other 
•soids. the finite sine and cosine transforms transform Junctions into sequences. 


Properties of the Transforms 

Before solving problems, we must derive some of the useful properties of these 
transforms. 

If tt(x.r) is a function of two variables, then (note we re transforming the x- 
variable ) 


%] = S„(t) = ~[ it(x.t) sin (tvtix/L) dx 
= c„(t) = u(x.t) cos (nnx/L) dx 

(Note that we transformed the x -variable and now have a sequence of functions 
in time alone.) 

What about derivatives? Here are a few of the more useful laws: 


CRJ [urd L]-C[u] - — [t/ ( (0,r) + ( - 1)"’ '«,(£../)] 


Solving Problems via Finite Transforms 

Solution of a Nonhomogeneous BVP via the Finite Sine 
Transform 

Consider the nonhomogeneous wave equation 

PDE u„ = u x , + sin (ir.v) <r< .v < I t) < / < x 


BCs 


«(0,r) = 0 
i/(l./) = 0 


0 < r < * 
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0 =s X =s 1 


ICs 


u(x.O) = 1 

.«,(*.0) = 0 


To solve this problem, carry out the following steps: 


STEP 1. (Determine the transform) 

Since the .r-variable ranges from 0 to 1, we use a finite transform. Also, you will 
see why, in this case, we use the sine transform. We could solve this problem 
with the Laplace transform by transforming t (it would involve about the same 
level of difficulty as the finite sine transform). 

STEP 2. (Carry out the transformation) 

Here, transforming the PDE, we get [we will call S n {t) = 5[m] for convenience] 
5[«„] = 5 [m„] + 5[sin (ttjc)] 

Using the identities for the sine transform, we have 
d 2 S (t) 

= - (/nr) 2 S„(f) + 2nw[«(0,/) + (-l)".*'u(l,r)] .+ £>„(r) 

= - (mt) 2 S„(t) + D„(f) 

where 

D (1 (r). - S[sin(ir*)] = jj ” I 3> 

(these are the coefficients in the Fourier sine series) 


a 



5,(0) * 
dSM 


UlMT n =1.3.. 

' l 0 " = 2 , 4 . . 

= 0 n = 1. 2, 3. . . 


S,(r) = A cos (nr) + (1/it) 2 


fO «-2, 4, ... 

5 "( f ) = — cos(nitr) n = 3,5,7,... 

[nit 

Hence, the solution u(x,r ) of the problem is 

u(x,t ) = [A cos (irf) + (1/tt) 2 ] sin (mrx) + ~ S 

cos [(2n + l)irf] sin [(2/t + l)tr.t] 


NOTES 


If we now transform the initial conditions of the boundary-value problem, we In order t0 apply 'he finite sine or cosine transform, the BCs at .r = 0, L 

will arrive at the initial conditions for our ordinary differential equation must both be of the form 


5[«(jr.O)] = 5,(0) = 


f 4/nir 

I o 


n = 1, 3, . . 
n = 2, 4, . . 


5[m,(*,0)] 


= dS " {0) = 


So, solving our new initial-value problem! s) 


ODE 


d-S„ 
dt 2 


(«“i'5„ - 



•&r-M 

uAL.t) - g (i) 


(use sine transform) 
(use cosine transform) 


In other words, the BCs u(0.r) = f{t) and u,(L.t) = g(t) wouldn’t work. 
Also. BCs like uJO.r) + hu(Q.t) = 0 don’t apply. There are other transforms 
for BCs like these: refer to the generalized sine and cosine transforms in 
reference 2 of Other Reading. 

In order to apply the finite sine and cosine transforms, the equation shouldn't 
contain first-order derivatives in x (since the sine transform of the first 
derivative involves the cosine transform, and vice versa). 
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OTHER READING 


1 Panic,! Differential Equation s by Tyn Myim-U. Elsevier. 1973. Several examples are 
worked by means of the finite sine and cosine transforms. This book has sood problems 
and is clearly written. w 

2. Operational Mathematics by'R. Churchill. McGraw-Hill. 1971 An excellent book 
covering the topic of integral transforms and their applications; more advanced than this 
, 00 '" Put “solul to anyone seriously interested in the technique. 
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LESSON 26 

Superposition (The Backbone of 
Linear Systems) 


PURPOSE OF LESSON: To introduce the idea of superposition and 
show how it can simplify problems by breaking them into subproblems, 
enabling us to solve the subproblems one at a time and then add the results 
to obtain the solution of the original problem. It is also shown that the 
two basic methods for solving linear equations, separation of variables and 
integral transforms, use the principle of superposition. 


For an engineer who wishes to find the response u to a linear system from an 
input /, a common approach is 

1. Break / into elementary parts, f = 2 f k . 

2. Find the system response u k to /*. 

3. Add (superimpose) the simple responses u k to get it = 2 u k . 

It turns out if the system is linear, then the sum u is the response we get if the 
function / were imputted directly; this is the principle of superposition (Figure 
26.1). 



FIGURE 26.1 Basic idea of superposition. 


We can use this basic idea to solve initial-boundary-value problems by break- 
ing the problem into subproblems, solving each subpart individually, and then 
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adding the results of each part (of course, the differential equation and the 
boundary conditions must be linear). 





should be able to show that the solution to 



u, = «„ -r fix.t) 
u(U.f) = 0 
u(l. r) = Cl 
if(.v.O) = d>(.v) 


u, = a,, + /(.v./) 
u(().t) = 0 
m(U) = 0 
u(a.O) = 0 


II, = u xx 
u(0,t ) = 0 
u(l,l) = 0 
u(x,0) = 6(x) 


Separation of Variables and Integral Transforms as 
Superpositions 

We may not think of superposition when using separation of variables or integral 
transforms, but. in fact, we are using the idea of an infinite superposition. In 
separation of variables, we generally break down the initial conditions into an 
infinite number of simple parts and find the response to each part. We then sum 
these individual responses to find the solution to the problem. 

On the other hand, integral transforms also use superposition, for instance, 
let's show how the finite sine transform uses this principle. Consider the non- 
homogeneous heat equation 

PDE u, = u„ - f(x,t) 0 < a < 1 0 < i < * 



and consider its solution by use of the finite sine transform. What we're really 
doinc is resolving the input fix. t) into components, finding the response U„ due 
to each component, and adding these responses. Mathematically, it may not be 
quite so obvious, but watch carefully. Wc start by expanding the PDE 
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", = "... + fix.t) 

into a Fourier sine series^/^ / 

(261) ,$ i A “ Sin ( "“’ v) * sin ("--Vi - £f„ sin (n-x) 


A „(t) = 2 [ u,(x.t) sin (n-x) dx 
B,M) - 2j[ u x fix,t) sin (/i~a) dx 
F n(0 = 2 [fix.t) sin (/17U-) dx 


sorted w .h f C °? ff,C,en ! S A "' B "' and F " are actually functions of r. since we 
s aned with functions of a- and r. Note, too. that we have resolved the input 

U <« S^r entS Wh3t We WOU,d ,ike t0 find is the '«P°nse 

rl r F " ( ) ' J bCn We WOuld add the U "(0 t0 8 et the solution u(x,t). 

To find the simple responses Ufit). we must take our resolved PDE (26.1) 
? nd per [. orni a calculus on the coefficients A fit) and Bfit), ,so that the 
integrands contain u instead of u, and u„. Integration by parts gives us 


Bfit) = 2 jf u xx 


2 J n u(x.t) sin (/7 7TA ) dx = - 


-(n-yu„(t) x 2/n: |m(0./) + (-lr^wfl,/)]. 


where Ufit) is the sine transform of u(x,t). Substiti 


a this last equation, we have 


and. hence, the resolved PDE (26.1) becomes 


+ (n-) 2 U„ - Ffit)] sin (n~x) = (I 
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Since this is an identity in r. the coefficients must he zero; that is. 

U' „ + = F„(t) 

Hence, we have our input-output relationship between F„ and U„. Before we 
can solve for (?„(/), however, we must go to the IC 

hU.O) = 0 

If we expand u(x,Q) as a sine series and set it equal to zero, we get 
21 *4,(0.) sin (n-rnr) = 0 

Hence, our initial conditions are 

U„[ 0) = 0 n = 1, 2 

We have now resolved bur original IBVP into the simple input-output problems 

O D Es U-„(t) + (rt-ir) 2 U„(t) = F n (ty ' 

ICs f/„(0) = 0 n = 1, 2, ; . . 

We can solve each of these problems by using an integrating factor (or Laplace 
transform, if we like); in any case, we get 

U„U) = e-— [e^-FjT) dr 

We have now found the responses U n {t) to the simple inputs f„(r). The final 
_step,_as the reader knows, is to sum these simple responses 

' u(x.t) = 21 Uh( 1 ) s > n (Hir.tr) 

to obtain the solution to the original problem. The reader should note that each 
14,(0 is weighted by sin (mrx). These, of course, are the same weights used 
when f(x,t) was decomposed into F„(r). 

NOTES 

In the finite sine transform, the resolutions were infinite series, whereas in most 
other integral transforms, the resolutions are integrals '^continuous resolutions). 
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It would be interesting if the reader carried out a similar superposition ii 
. pretation for the problem 


IC «(.v,0) = <t>(.c) 


for the exponential Fourier transform (on x). This is essentially what was done 
in lesson 12 when we solved this problem with Green's function. 


1. Show that if h, and u 2 are the solutions to problems P t and P 2 in the lesson, 
then u, + u 2 satisfies problem P. 

2. Solve the IBVP 

PDE m„ = u JX + sin (3ttx) 0<.r<l 0 < t < * 


ICs O *** 1 

(«,(*,()) = o 

by superposition (each subproblem can be solved in any manner you like). 

3. Suppose «, and u 2 are solutions of the following equations; for which equa- 
tions is m, + u 2 a solution? 

(a) u, = u xx 

(b) u, = u„ + * 

(c) u, = e-u„ 

(d) it, = «„ + u> 

What conclusions can you reach from your answers? 

4. Find fourinitiai-boundary-value problems whose solutions sum to the'scf-’ 
lution of the following problem: 


0<r<* 

“( 1.0 = g :(0 

«(jr,0) = d>(.r) 0 e x s 1 


ODE U'„C) + 0™) : L'At) = F„(i 

IC (4,(0) = 0 
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Can you verity tin* solution? 

Suppose n, and both satisfy the linear homogeneous BCs 
u,(0.r) - /i = 0 

H,(].f) - /);!/( 1 j) = 0 

Does it- - a also satisfy the BCs? 


OTHER READING 

A First Course in Partial Differential Equations by H. F. Weinberger. Ginn and Company. 
1465. This text contains a good section on linearity and superposition: it also has a large 
section on complex variables. See Chapter 2 in particular. 
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LESSON 27 

First-Order Equations (Method of 
Gharacteristics) 


PURPOSE OF LESSON: To introduce the notion of first-order partial 

differential equations (so far. we've studied only second order) and intro- 
duce an important technique for solving initial-value problems (method of 
characteristics). The problem we will solve is the initial-value problem 

PDE a(x,i)u A ■+ b(x,t)u, 4 c(x.l)u = () -sc < , v < sc 
0 < t < x 

IC U(x.O) = <t>(A) -sc < X < CC 

Note. that this is the first time we've solved problems with variable coeffi- 
cients. It turns out that if we change coordinates from (x.t) to appropriate 
new coordinates (j,t) (characteristic coordinates), then our differential 
equation becomes an ordinary differential equation. Hence, we solve the 
ODE to find m(j,t). and, then, the last step is to plua in the values of 
s and t in terms of x and t to get u(x,t). 


If the reader recalls, whe" we solved the diffusion equation 

tt, = o tm ai - vu x - sc < x < * (I < t < X 

the constant a- stood for the amount of diffusion, while v stood for the velocity 
of the medium. Hence, if a = 0 (no diffusion), it is clear (since we only have 
convection) that the solution will travel along the A-axis with velocity v. In other 
words, if the initial solution is «(x,0) = <|>(x). then the solution to' 


would be tt(x.r) = <b(x - tv). 

So (one interpretation) we can think of the first-order equation 
a{x.t)u , + b(x.t)u, = 0 
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as the concentration along a stream where the velocity is given by 
v = - a(x,t)/b(x,t) 

Of course, if a(x,t) and b(x,t) are constants, then we have traveling wave so- 
lutions; on the other hand, if u{x,t), b(x,t) change in x and /, then the stream 
velocity varies as we go along the stream and with time (the reader can see that 
the initial curve can get very distorted). 

So much for the convection analog; let's get back to our basic problem 

PDE a(x,t)u, + b(x,t)u, + c(x,t)u = 0 -* < x < * 0 < t < * 

IC u(x, 0) = 4>(*) -*<*<» 

The solution to this (linear first-order homogeneous) equation is based on a 
physical fact, namely, that an initial disturbance at some point. r propagates along 
a line (curve) in the tar-plane (called a characteristic). See Figure 27.1. 



FIGURE 27.1 The initial solution at x affects the solution only along a line in 
the xf-plane. 

This phenomenon contrasts with many other equations (such as the heat equation 
u i = «„) where an initial disturbance at a point affects the solution everywhere 
else later in time. Also, if the reader recalls, the initial-position disturbance of 
the violin string at a point x affected the solution along two lines in the cr-plane 
(corresponding to two moving waves). See Figure 27.2; 

Solving this I VP, we get 



FIGURE 27.2 Initial disturbance u[x. 0) at a point giving rise to two waves. 
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To evaluate the constants and c : . let s = 0, and referring to Figure 27.1. let 


■v(0) = t 
fill) = «> 


Doing this give:- value? o; ; . = t and <■■ = 0. Hence, out characteristic curve:- 


To sec what these curves look like in the r.v-plane. we can eliminate s from these 
equations to get 

x - t = 7 - X < T < * 

(for each value of 7 we get a straight line: for example, when 7 = 0. we get t 
= x). See Figure 27.3 

hr 



Solving this I VP. we get 

u(s. 7 ) = sin 7 e~ z ' 

(Note that we have written u as a function of both s and t). 
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f 



50 tins is the solution: the only problem is that it is in the u rone coordinate 
system. It would be better if we found it as a function of v and t This is done- 
in Step 3. 

STEP 3 We now solve the transformation 


for s and 7 in terms of x and t. We have 


Hence, our answer is 

u(x,t) = sin (x - r)e~ 2 ' (check it) 

You can see that this means that the initial wave u(*.0) = sin v is moving 
to the right (undistorted in this case) and damping to zero (Figure 27.4). 



FIGURE 27.4 Solution moving with constant velocity to the right and 
damping to zero. 

We now summarize what we have been saying. 

General Strategy for Solving the First-Order Equation 

Suppose we are given the IVP 

PDE a{x.t)u x + b(x,t)u, + c(x,t)u = 0 - ^ < a< « 0<r<« 

IC u(x,0) = /(a) -oc < x < x 

STEP 1 Solve the two ODEs (characteristic equations) 

dx dt 

Js ~ a(x ' l) J s = *<*•') 
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™ r r s zr„trs;':, 0 t“ in8 1<0) - u - w » 


STEP 2 Solve the ODE 


■ C[*(J.T), f(j,T)] M = 0 0 < J < X 


IC «(0) = /( T ) 

SicL a n“ S “ bS,iU,, ' d 'h' Va ‘ UeS o''.**'* *' «• t imo the 

in step 1) and substitute these values into u(s,r). 

We now apply these steps in the following example (not. variable coefficients) 

Another Example 

PDE xu, + u, + tu = 0 -* <* < « ' . o < t < oc 

IC u(x,0) = F(x) (an arbitrary initial wave) 


- = -t has solution x(i) = c K e 


— - 1 has solution • t(s) = s + c 2 


hito'new coordfoatesis’ ‘ ' ™ dCl ’ ° Hence, the transformation 
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<(0) = F(t) 


i 

! 


! 




i 


! 


The solution is 

h(s.t) = F(x)e'' : 

STEP 3 Solving for s and t gives s = t. t = xe~‘. Hence, the solution 
u(x.t) = F(xe ~')e 

In other words, if the IC were u(jr.0) = sin .r. then the solution would be 
i i(x,t) = sin (xe~')e~ ,: - 


NOTE 

The reader may. wonder why second-order PDEs were discussed first in this 
book and first-order equations second? From a mathematical point of view, we 
could have easily switched them around. However, since. the techniques for 
solving second-order equations don’t rely heavily on first-order ideas and since 
second-order equations are more important, we decided to study second-order 
equations first. 

In the study of ordinary differential equations, the situation is different. The 
method of solution, the general theory, and so forth, follow naturally from first- 
to second-order equations, so text books always cover the first-order case first. 

PROBLEMS 

1. Solve the simple concentration problem 

PDE if, + u, = 0 -x < .v < x 0 < t < x 

IC «(.t,0) = cos x - x < x < * 

What does the solution look like? Does it satisfy the PDE and IC? 

2. Solve the problem 

PDE xu, + tu, + 2u = 0 - x < x < a 1 < t < X 

IC tt(x, 1 ) = sin x -x<. r <* 

(note that time starts at t = 1 here). What do the characteristics look like? 
Plot the solution for different values of time. And. of course, check the 


3. Solve the problem in higher dimensions (surface waves) 
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Check the answer. 

It is possible to specify the solution u on a curve other than the usual initial 
.line r = 0. In fact, the differential equation doesn't have to involve the time 
variable at all (maybe it depends only on space variables). Try to solve the 
more general problem 


PDE u, + 2 u, + lu = 0 
Initial 

curve u(x,y) = F(x,y) on the curve C: y = 



[the function F(x,y) is assumed given). 


OTHER READING 

Techniques in Partial Differential Equations by C. R. Chester. McGraw-Hill. 1971. A 
clear, concise description of first-order PDEs: an application to gas dynamics is given in 
Chapter 13. 
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LESSON 2ft 

Nonlinear First-Order Equations . 
(Conservation Equations) 


PURPOSE OF LESSON: To introduce the idea of first-order nonlinear 
equations and to show how certain ones (so-called conservation equations) 
can be used to describe physical phenomena. One particular conservation 
equation 

U, + g(u)u, = 0 

along with initial conditions 

u(x,0) = d>(jr) 

is used to describe the flow of automobiles along a freeway. This example 
points out that PDEs can be used to describe physical phenomena other 
than the usual ones in physics, biology, and engineering. It turns out that 
this particular nonljnear equation can give rise to discontinuous solutions 
(shock waves) that propagate along the road. 


One of the most useful partial differential equations in mathematics is the 
conservation equation 


This equation says that the increase of a physical quantity u, is equal to the 
change in flux - f x of that quantity across the boundary (flux is measured left 
to right). In fluid dynamics , u(x,t) could stand for the density of a fluid at x. 
while f(x,t) could be the flux (amount of liquid passing a point x at time I). In 
order not to get involved in the many details of fluid dynamics (such as as- 
sumptions of nonviscosity, incompressibility, and so forth), this lesson shows 
how the conservation equation can be used to predict traffic flow (flow of cars 
rather than the flow of water molecules). We first derive the conservation equa- 
tion. 
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Derivation of the Conservation Equation 


«(*./) =• density of cars at .r (cars per unit length at x) 
f(x.t) flux ot cars at .v (cars per minute passing the point x) 

Then, it is fairly obvious that for a road segment [a.b], the change in the number 
of cars (with respect to time) is given by both of the fo.lowing^expressions 

Change in the number of cars in [a,b\ = ^ fu(x,t) dx 

and 

Change in the number of cars in [a,b\ = f{a,t) - f(b,t) = - f% t) dx 

Jo dx y . 

i ~i (x,!> dx 

equa'l^ hence tT"? l ‘ M - arbi,rary ’ We have <hem,elv es 

equal, hence, the one-dimensional conservation equation 

+ f, = 0 

If we carried out a similar analysis in two of three dimensions, we would have 

+ f' + ~ ° ( Conservation equation in two dimensions) 

+ }x + A + A = 0 (Conservation equation in three dimensions) 

Conservation Equation Applied to the Traffic Problem 

is noth i n § v ery complicated about the equation u, + / = 0- it’s iust th-,r 
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intents can be performed to find f(u). It seems obvious that as the density a 
increases, the flux /increases (to a point, anyway). A typical model for traffic 
flow would be the equation 



FIGURE 28.1 Typical flux versus density curve. 

Other flow rates could, be 

1. /(«) = ku (linear flow rate) 

2. /(«) = u 2 (Quadratic flow rate) 

For a complete description of flow rates in traffic control, see reference 4 of the 
recommended readings. 

. . We are now ready to see how the conservation equation u, + f, = 0 can be 
applied to the traffic problem. To do this, we rewrite the change in flux f, as 
f x = ( dfldu)u x (chain rule) and substitute it in the conservation equation. Doing 
this, we arrive at 


h — U x = U, + g(«K 


For example, if we find that-the flux depends on the density using the equation 
f(u) = it 2 , then the conservation equation becomes 


Hence, if the initial density of the cars was u(x,0) = d>(.r), then in order to find 
the density at any time t , we would solve the IVP 


With these ideas in mind, we now solve a nonlinear initial-value problem 
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The Nonlinear Initial-Value Problem 

PDE u, '+ g(u)u t = 0 -x < x < «■ 0 < ! < x 

IC »(.v.0) = <t>(.v) — x < x < x 

If ihc reader recalls the previous lesson, where we studied the convection eoua- 



Here. we can claim that the solution it(x.r) of our initial-value problem has the 
value one along the line x - 2 + 3r. That is u ( 2 + 3r,rj = 1 for all t > 0. Both 
the general characteristics and this specific example can be seen in Figure 28.2. 



<*0. 0) o (2. 0] 


FIGURE 28.2 Characteristic curves of u, + g[u)u, = 0. 

It is now clear that by knowing these characteristic curves starting from each 
point (and knowing the solution doesn’t change along these curves), we can 
piece together the solution u(x,t) for all time t. We won’t actually find the explicit 
equation for the solution u(x,r) in terms of x and t but will use our knowledge 
of the characteristics of the equation to solve some interesting problems. 

Traffic-Flow Problem 

We will now .-solve. a. traffic-flow problem where the flux is given by /(u) = u 2 
and the initial density of cars is given. In other words, we have 

PDE u, + 2 uu x = 0 -3=<a<*= 0<r<x 


fl 

IC u(x,0) = { 1 - x 0 < x < 1 
[O l«x 

See Figure 28.3. 



FIGURE 28.3 Initial density of cars moving left to right. 
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«* <*- p°' nt (..o,. 


x = x » + s(«(* u .0)]r 

= *11 + g[l]l 

= X„ + 2 1 

Solving for t, we get the lines 



+ rt«(»*0)]r 

■ '<* + *(0 ~ JC 0 )]/. 

= r o + 2(1 - Xo )t 

Again, solving for r, we have 

t - x ~ Xn 

~ 2(1 - ^ 0 ) _ 

Finalljr,. for 1 « < *>, we have the characteristics 

^ + 5(«(x o ,0)]f 

= + g[0]r 


which represents vertical lines startine at jit tHp . • • 
can be seen in Figure 28.4. S o- he characteristics of this problem 



FIGURE 28.4 Characteristic of the equation u, + 2uu, = o. 
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It is now clear how the traffic behaves for 0 < r < 1/2. Looking at Figure 
28.5, we can draw a few values of the solution for various values of time. 



FIGURE 28.5 Density of traffic at different values of time. 

Note that the characteristics run together starting at t = 1/2; hence, to find the 
solution past t - 1/2, we must use another type of analysis. When characteristics 
run together, we have the phenomenon of shock waves (discontinuous solutions), 
and what we must ask is, how fast does the leading edge of the shock wave 
propagate along the road? A more detailed discussion of shock waves and further 
references can be found in reference 2 of the recommended reading for this 
lesson. Although not obvious, it turns out that the speed of the discontinuity is 
given by 

n _ fjMA ~ /(“«■) 


where u„ and u L are the values of the solution at the right and left of the wave 
front, and f{u K ) and f[u L ) are the values of the flux at these points. So, in our 
example, the speed of the wave front would be [remembering that /'(«) = tr) 


This means that for t > 1/2, the wave front will move from left to right with a 
velocity of one. 
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The complete picture of the solution to 



can be illustrated by Figure 28.5 

NOTES 

1. The shock wave in our example occurred because the flux grows very large 
as a function of the density u. If. on the other hand, the flux were given by 
f(u) = u, then the PDE describing the flow would be u, + u x ■= 0, and the 
solution would be an undistorted moving wave (the initial wav? would just 
move to the right). If we think for a moment about what /(«) = u means, 
then it is obvious the solution will move in this manner. 

2. We can actually verify by direct substitution that 

« - 4>[x - g(w)'] 

is an implicit solution of the nonlinear problem 

u, + g{u) u x = 0 -* <x < « 0 < t < « 

u(x, 0) = <t>(x) — < X < oe 

For example, the implicit solution of the initial-value problem 

PDE u, + uu x = 0 

IC u(x.O) = x 


u = <b[x - *(«)/) 

= X - g(u)t 

= X - ut 

In this particular example (although we can’t do this in many examples), we 
can solve for u(x,t) explicitly in terms of x and t. Doing this, we get 



Check it. 
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PROBLEMS 


1. Solve the I VP 

PDE u, -r uu, = 0 —*<*<*. 0 < t < x 



Draw the solution for different values of time. What is your interpretation 
of this solution? What is the relationship between the flux and density in 
this problem? 

2. Solve 

PDE u, + t<x -O' — * < x < ® () < r < x 

I( ~ t . _* fo x < 0 

IC Os, 

What is the flux-density relationship? Would you expect the solution to 
behave as it does? Compare the solutions of problem 1 and problem 2. 

3. Suppose a nonviscous liquid is traveling through a pipe and suppose the 
liquid leaks through the walls of the pipe according to the law F(u) = ku 
(g/cm sec). The conservation equation (nonconservation equation now) be- 
comes 

~Ku) 

What is the solution of this equation if /(m) = MandM(x,0) = 4>(x) (a general 
initial density)? What is the interpretation of your solution? 

4. What is the solution to this nonconservation equation if the loss to the 
outside is changed to F(x,t) - 1/x? Does your solution check? Does it make 
sense physically? 

5. Verify that u = 4>[x - g(«)/] is an implicit solution of the nonlinear problem 

PDE m, + g(u)u x = 0 

IC m(x, 0) = 4>(x) 


OTHER READING 

1. An Introduction to Fluid Dynamics by G. K. Batchelor. Univesitv Press, 1970. An 
excellent, comprehensive book on fluid dynamics. 

2. Formation anti Decay of Shock Waves by P. Lax. Mathematical Monthly. March 
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1972. A readable account of how shock waves nmm.ni.* in , 

mathematician. ‘ ^ P‘^ aIe »n space, written by a leading 

first-order nonlinear equations with examples. ‘ P a " 1Ce descr, P ,ion of 

4. Mathematical Theory/ of Traffic Control h« P a u ■ . 

one A 
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LESSON 29 


Systems of PDEs 


s 

i 

f 


! 


In many areas of science, several unknown quantities (and their derivatives) are 
related by more than one equation. For example, in fluid dynamics, the four 
equations. 


(Conservation of momentum 
in .v-direction) 

(Conservation of momentum 
in v-direction) 

(Conservation of mass) 



PURPOSE OF LESSON: To point out that many physical systems 
(particularly in fluid dynamics) cannot be described by a single PDE but, 
in fact, are modeled by a system of interlocking equations. In these equa- 
tions, several unknown functions like pressure = p{x,y,z,t), density = 
p(x,y,z,t) and temperature = T(x,y,z,t) (and their partial derivatives) are 
described by physical laws, and we seek to find all of these functions 
simultaneously. 

It will also be shown how the linear system of equations 


can be solved by decomposing it into a 
tions 


v system of independent equa- 


(This way, each equation can be solved separately.) 
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vhere 


p(x,y,t) = Pressure of a fluid 
u(x,y,l ) = x-velocity of a fluid 
v(x,y,t) = v-velocity of a fluid 
p(x.v.r) = Density of a fluid 

constitute a nonlinear system of PDEs known as Euler’s equations of motion for 
a fluid. The problem we face here is to find the unknown functions p, u, v, and 
p simultaneously that satisfy the four equations (along with initial and boundary 
conditions). 

There are other reasons for studying systems of equations. If the reader recalls 
ODE theory, a second-order ordinary equation can be written as a system of 
two first-order equations. Although things are not quite so simple in PDE theory, 
it is often possible to write a single higher-order PDE as a system of first-order 
equations. For example, the telegraph equation . 

u„ = c : u„ + cm, + bu 

can be rewritten in equivalent form as three first-order PDEs by introducing the 
three variables u„ u } , u. 


m, = M 



It is a simple matter to se.e that the telegraph equation is equivalent to the three 
equations 

du, 

— - u 2 


du 3 

Ht 


+ bu, 


In order to solve systems like equations (29.2), it is necessary to be familiar with 
the eigenvalues and eigenvectors of a matrix. For that reason, we present a short 
review of linear algebra. 
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Linear Algebra Revi< 


General Case 


Special Case 


Definition: If A is an n by n matrix, 
then the n eigenvalues of A are the 
n roots of the polynomial equation 

det (A - X/) = 0 

where det (A - XV) is the determi- 
nant of the matrix (A — Xfl. Some ei- 
genvalues may be numerically the 
same. 


Definition: If X is an eigenvalue of the 
matrix A, then an eigenvector cor- 
responding to X is a nonzero vector 
satisfying Ax = kx. 


Definition: The inverse of a matrix 
A is the matrix A~' that satisfies 
AA _I = A~'A - /, where / is the 
identif' matrix. 


Example: 



Then the two eigenvalues are the 
roots of the equation 



= (1 - X) 3 - 4 
='X 3 - - 2X - 3 = 0 

or X, = - 1 and X 2 = 3. 

Example: X - ^ j is an eigenvector 
corresponding to X : = 3, since 



Example: The inverse of 



Diogonalization of a Matrix 

If A is an n by n matrix with n distinct eigenvalues X,, X 2> . . . X„ and if 
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“ ' hC ma ' ril WhK ' *. rorrespondins |hen 
P-'AP = ,\ 

-here />-’ is the inverse of />. a „ d A „ , he diagona , matrh 



For example, the matrix 



has eigenvalues X, . 4 end X, - -4. with corresponding eigenvector 

“ d ■«-['?] 

Hence, the following product: 

■["»!?][!:][!-!] 

is equal to the diagonal matrix 


(The reader can check this.) 

I now solve a simple system of two equations (along with their ICs). 
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Solution of the Linear System u, + Au x = 0 


Consider the intitialrvalue problem consisting of two PDEs and two ICs 


IC 2 Hi(je,0) = g(x) 

This problem might correspond to finding k,(jc, 0 = pressure and u,(x.t) - 
density as a function of (a space variable) x and (time) t when we are given the 
initial pressure and density. 

We start by writing the two PDEs in matrix form 


Now, we introduce a new unknown (change of variables technique) 


by means of the transformation: 


where P is the matrix whose columns are the eigenvectors of A (w< 
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These are the two uncoupled equations that we can solve independently. In fact, 
the reader should know that these equations have travelling-wave solutions 

v,(x.i) =' <l>(.v - 4/} 

\\(.\.r) - d)(.v + At) 

(where o and ut are arbitrary differentiable functions). 

These are the values of r, and r,. To obtain our general solution it, we merely 
compute 



’2<Kx - 4r) - 2t|/(x + 4/)" 
(bU -4r) + + 4/) 


In other words. 

(29.8) u, (x,t) = 2$(x - At) - 2iK* + At) 

u 2 (x,t) = 4>(* - At) + vJ/(a + At) 


Hence, we have found the general solution to the two PDEs of problem (29.3). 
A typical solution (there are an infinite number) would be to let 


4>(i) = sin | 

m = e 


(Two arbitrary functions) 


and, hence 


u,(x.t) = 2 sin (a- - At) - 2(x + 4r) : 
u 2 {x,t) = sin ( x - 4r) -r (.v + At) : 

We now substitute general solution (29.8) into the ICs 

«,(*.' 0) = fix) 
n,(x,0) = g(x) 


to get 


2 «Mx) - 2Mx) = fix) 
4>(a-) + i|/(a) = g(x) 
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Solving for d> and ih gives 


4>(.r) = 1 [f (x) + 2g(x) i 

^ \ [2 g{x) - f(x)] 

and, hence, the solution to IVP (29.3) is 

= 2cf>(.r - 4 1) - 2v|/(jt + 4 t) 

(m _ 9) ' 5 - •*»] - l M, + 4,) - Kx t 4,,, 

u i( x '0 = <t>(.r - 4r) + ^( x + 4/) ' 

^ ~ 40 + 1S{X ~ 4 ')1 + j Rl g{x + 4r) - /(,+ 40] 

NOTES 

1 

often be necessary to write vour hither ^ USmS - heSe pro S rarns > i( will 
2. The linear system * ,ghCr ° rder equation as a ^tcm; 

u, 4 - A(x,t)u x = 0 

can also be solved similarly to the wav we solved u + Au - 0 The • 
difference is that now the m-uriv p ■ ‘ A ' ~ The major 

of x and r. I* 0 *** 

PROBLEMS 

1- Write the system of PDEs in equations (29.2) in matrix form 

Au . ~ Bu, + Cu = 0 

, p: h n e d r th 4, *' :,m, , Carethr c-- three matrices, 
nd the eigenvalues and eigenvectors 0 f the matrix 
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LESSON ZQ 

The Vibrating Drumhead (Wave 
Equation in Polar Coordinates) 


PURPOSE OF LESSON: To show how the wave equation can describe 
the vibrations of a drumhead. The basic equation here is the wave equation 


which, if we look for fundamental standing-wave solutions 
u(r.fl./) - R(r)0(0)7XO 

is reduced to three ordinary differential equations 

T' 4- XVT = 0 (Simple harmonic motion) 
rR" + rR’ -f (XV - n : )R = 0 (Bessel’s equation) 

0" + n 2 Q = 0 (Simple harmonic motion) 

All products.f?(r)0(0)T(f) of solutions to the three ordinary differential 
I equations describe the basic vibrations of the drumhead, while K(r)0(0) 
describes the shape of the vibrations. To find the vibrations of the drum- 
I head that satisfy arbitrary initial conditions, we add the basic fundamental 
vibrations in such a way that the initial conditions are satisfied. 


The purpose of this lesson is straightforward: to find the vibrations of a circular 
drumhead with given boundary and initial conditions. For simplicity, we let the 
radius of the circle be one and the boundary data be zero. Hence, the problem 
is to find u(r.O.t) (which stands for the height of the drumhead from the plane) 
that satisfies 

PDE u„ = c 2 ^t/ r , + -u r + 0 < r < 1 

BC it = 0 when r = 1 0 < r < x 
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ICs 


See Figure 30.1. 


' « = o 

FIGURE 30.1 Vibrating drumhead (hyperbolic IBVP). 

To solve this problem, we recall the violin-string problem from Lesson 20 
whose solution involved the superposition of an infinite number of simple vi- 
brations. If we approach the drumhead in a similar manner, we will look for 
solutions of the form 

u(r, 0, f) = U{r,Q)T(t)^j' 

This gives the shape U(r,Q) of the vibrations times the oscillatory factor T(t). 
Carrying out this substitution (problem 1 in the problem set), we arrive at the 
two equations : ' 

V J C/ + \ 2 U = 0 (Helmholtz equation) 
r + XVT = 0 (Simple harmonic motion) 

where 

v j t/ = u„ + -u, + \u m 

Note that we have required the separation constant to be negative (hence, we call it ’X J ), 
since we want T(t) to be periodic. 

For our next step, we want to solve the Helmholtz equation, but. first, it 
needs a boundary condition. To find it, we substitute u(r,Q,t) = U(r,Q)T(t) into 
the boundary condition of the drumhead to get 

u(l,0,r) = t/(l,0)T(r) = 0 0 < / < oc 

or 

U{ 1,0) = 0 

Hence, we now have the following problem to solve in order to find the shapes 
U(r.Q) of the fundamental vibrations: 
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W T \-U = 0 
U(lS) = () 

smmssm 

PD ES » ith «ro boundan, eU JS'3^ ) b ""~ 

fsubprob/em* Helmholt2 Eigenvalue Problem 

To solve 

PDE 7 -u + \ 2 u = 0 
BC £7(1.0) = o 

we let 

U(r,e) = R(r)Q( 6) 

and plug it into the Helmholtz BVP. Doing this, we arrive at 

K(i) t, f + (XV ~ n2)R = 0 (Bessel's equation) 

0" + « 2 e = o 

5%££££5££=5*=?S 

H/?" + r R' + (XV - /!-).«? = 0 0 < r < 1 

*(°) < 30 (Physical condition) 

/?(1) = 0 
0" + n 2 e = o 


Bessel's Equation 

The equation 

^ R " + rR ' + (XV - n*)R = () 
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• is well-known in ODE theory, it is called Bessel’s equation and has two linearly 

independent solutions. They are 

R,(r) = AJ n (\r) /i-th-order Bessel function of the first kind 

/?>(r) = BY^r) /i-th-order Bessel function of the second kind 

. and, hence, the general solution (all solutions) to this equation is 

R(r) = AJ„{kr) + BY„(kr) 

Note that the solutions depend on the n and X. in the equation. The graphs of 
these functions are well-known and can be found in reference 2 of Other Reading. 


S Also see Figure 30.2. 



FIGURE 30.2 Bessel functions. 


In order to find the functions J„(hr) and Y„(\r). we must resort to the method 
of Frobenius. which is to find solutions R(r) as power series. It turns out that 
we can find ru-o linearlv independent power series JJ\r) and YJ\r). Since the 
functions YjKr) are unbounded at r = 0. we choose as our solution 

R(r) = AJ.,{\r) 

The last step in finding R(r) is to use the boundary condition R(l) = 0 to 
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find X (we re not interested in finding the coefficient A at this time). Substituting 
/?(1) = 0 into /?(>•) = AJJM). we have 

JM = o 

In other words, in order for R(r) to be zero on the boundary of the circle, we 
must pick the separation constant X to be one of the roots of JJr) = 0: that is. 

X = k„,„ 

where k nm is the m-th root of J„(r) = 0. Tables of these roots are well-known, 
and computer programs are available to find them. A few of these roots are 
listed in Table 30.1. 

TABLE 30.1 The m-th Root of J n {r) = 0 


0 12 3 4 



1 

With these roots, we have just solved the Helmholtz eigenvalue problem. The 1 

eigenvalues X are k„,„\ and the corresponding eigenfunctions U„ m (r,Q) are i 


We plot these functions for the different values of n and m in Figure 30.3. The 
general shape of U„„,(r.Q) is the same for different values of the constants A and 
B. Only the height of the vibration and placement of 0 = 0 is affected. 

Each r.fl) represents a fundamental vibration of the circular membrane with 
frequency 

f„„. ~ k„„, c/2-t i cvcles/unit time 
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FIGURE 30.3 Fundamental vibrations of a circular drumhead showing nodal 
lines. 


We find these frequencies by solving the time equation 

r + k\ m c 2 T = o 


to get 


= A sin ( k nm ct ) + B cos ( k nm ct ) 

This solution is a simple oscillatory vibration with frequency 
fnm = k nm c/2n cycles/unit time 

It is interesting to note that the ratio of the frequencies of U n Jr, 0) to the 
fundamental vibration U„,(r,e) is 

■ 

fm k m 

which is not an integer as it was in the one-dimensional wave equation. In other 
words, higher vibrations for the drumhead are not pure overtones of the basic 


The Vibrating Drumhead (Wave Equation in Polar Coordinates 237 




f = ie. No,, , ha , the «*,**, (wherc „„ vibralio| , , ate p|ace) 

k -‘ k -> k„ 

k„ k„ k„ ~ * 

vT*)Z final step for the «"* shapes 

= A sin (k„ m ct) + B cos (k nm ct) 


"(^.Q.O ~ ^ S cos sin (I- c) + fl cos | 

S£r : ”-«=.t 

f *?‘ her than , g0ing thr0Ugh the complicated process bf finding X and B 

SESSsP 

«M.O) = /(r) 
w,(/-,0,O) = 0 

■SZ&Z'ZZ? •”* CMe where * “•> w " h ««• »•»*«: -h« 


(30.1) 


"M = i A,J„(k r) cos- (A- a) | 


and our goal is to find A„ so that 
00 2) 

<^)" d J h iTr n “ t"' "" ““ ,he -ondition of ,he Bes^l { J„ 
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f rUk, t ,r)J n (k n ,r) dr = <! 

^i(U 


(the evaluation of this integral can he found in books on Bessel functions). 
Hence, we multiply each side of equation (30.2) by rJ„{k,„r ) and integrate from 
0 to 1 . giving 


Aj j" rJ-,(k, v r ) dr = j rf(r)J n (k,„r) dr 


(30.3) 


= 4 


r/(ry,,(k,„r) dr / Jf(k n/ ) j = 1. : 


The solution to the vibrating membrane (indepent of 0) is equation (30.1). where 
the coefficients are given by equation (30.3). 

This solution is not so complicated as the reader might think. We can interpret 
it as expanding the initial condition f(r) as the sum 

- f(r) = A'MKA + -V, .(*»/) + AJ u (k„r) + . . . 

and then inserting the oscillation factor cos (k IUn ct) in each term; that is, 

u(r,t) = /4,7„(A: ()I /-) cos (k ai ct) + AJ„(k n2 r) cos {k u2 ct) + ... ' 

For example, the solution to the vibrating membrane with initial conditions 

M(r.0.O) = 7„(2.4r) + 0.57,, (8. 65r) 
ft, (r, 0,0) = 0 


u{r,t) = 7„(2.4r) cos (2.4ct) + 0.57„(8.65r) cos (8.65a) 


Interpretation of J 0 [k w i), J 0 {k Q 2 r), ... 

It would be helpful for the reader to know the interpretation of J„(k.„r). J„{k„,r). 
.... inasmuch as the solution is the sum of these functions. We start bv drawing 
J„(r) (Figure 30.4) 
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FIGURE 30.4 Zero-order Bessel function J 0 (r). 

Now . in order to graph the' functions J„(k m r). J ( ,(k 0 ,r). . . . J n (k om r) we rescale 
the r-axis so that the m-th root passes through r = 1 (Figure 30.5). 



FIGURE 30.5 Graphs of J(k 0m r) (basic building blocks of the vibrating 
membrane). 

NOTES 

1. Suppose we initially displace the circular drumhead (with c= 1) with the 
ICs 

fu(r.6.0) = J 0 (2Ar) + 0.1Q/ O (5.52r) 

[w,(n9-°) = 0 (Initial velocity zero) 

See Figure 30.6. 



FIGURE 30.6 ICs decomposed into basic shapes. 
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In general, what we would do is expand the initial position /(r) into the sum of 
these basic shapes J„(k ihn r). observe the vibration for each one. and then add 
them up. The basic physical principle of the vibrating membrane is that each 

basic shape /„(2.4r). J„(5.52r) Jo(k„„,r). . . . gives rise to its own simple 

harmonic motion (each point on the membrane vibrates with the same fre- 
quency). Here, since our IC is the sum of two basic shapes, the vibration of the 
membrane will be the sum of the two simple harmonic motions caused by the 
shapes: that is. 

u(r.t) = 7„(2.4r) cos (2.4/) + 0.1U/„(5.52r) cos (5.52/) 

Note that these two superimposed vibrations are complicated and that the higher 
frequency is not a multiple of the lower. 

2. For the vibrating membrane with initial conditions u = f(r). u, = 0. we can 
interpret the solution as expanding the initial condition f{r) as a sum of basic 
building blocks A,J a (k„,„r) and let each. of-them vibrate with its own frequency 
cos (k u ,„ct), giving the fundamental vibration 

A,J»(k lh „r) cos (k (lm ct) 

We then add them up to get the vibration resulting from the initial condition 
/(')• 


PROBLEMS 



1. Substitute u(r,0,/) = U(r,Q)T(t) into the wave equation 



in order to separate it into the two equations 
V*t/ + KW = 0 

r + x 2 c'T = o 

2. Substitute U(r,Q) = /?(r)Q(fl) into the Helmholtz BVP 

V 2 y + k 2 U = 0 
. t/(1.0) = 0 

to get 

r 2 R" + rR' + ( k 2 r - n 2 )R = 0 
* 0 ) = 0 
0 " + n 2 B = 0 
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Why do we choose the separation constant to be 0. 1.2 
decide to cal! /»-)? 


PDE 

BC 

ICs 

PDE 

BC 


u„ = V 2 h 0 < r < 1 

«( 1.8.0 = 0 0 < t < x 

f«(r,0.O) = 1 - ^ ( 

|i/,(r,0,O) = 0 U ^ r 

u„ = 0 < r < 1 

«( 1.0,0 = 0 0<f<X 

0« r 


«M,0) = M2Ar) 

!«,(/•, 0 , 0 ) =0 


5 ' S ° lv ® P roblem 4 but w >th the initiaP position of the membrane replaced by 
«(r,e,0) =/„(2.4r) - 0.57, ,(8. 65r) + 0.257 o (I4.93r). What: is the highest 
frequency in the vibration? 

6. Graph the following functions for 0 =s r 1- 

(a) 7„(5.52r) 

(b) . 7„(14.93r) 


OTHER READING 

U Equations of Ma^matical Physics by A. N. Tikhonov and A. A. Samarskii. Macmillan. 
1963; Dover, 1990. A comprehensive text with many examples; very good for engineers and 
physicists. The book solves the problem of the square. drumhead; see-Chaprer 573in -particular.' 
2. fables of Functions with Formulae and Curves by E. Jahnke and F. Emde. Stechert 1941- 
Dover, 1945. One ot the best known books of tables; roots of Bessel functions are tabulated here.’ 


PART 4 


Elliptic-Type 

Problems 
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LESSON 31 


The Laplacian (an Intuitive 
Description) 


PURPOSE OF LESSON: To present an intuitive description of the 
Laplacian and show what it looks like in various coordinate systems. The 
most common coordinate systems in two and three dimensions are: 


7 2 U = U„ + M,., 

Cartesian 


1 

1 

(Two dimensions) 

V 2 u = u„ + -ii, + 
r 

r 2 99 

Polar 


V 2 W = U„ + Uyy + 

1 

1 

Cartesian 

(Three dimensions) 

V 2 « = u„ + -u, + 

— u 99 

+ u SJ Cylindrical 


V 2 u = u„ + -u, + 


cot <t> 1 

t 99 Spherical 

r 2 U +* 

U * r 2 sin 2 <j/ 


Since the problem of transforming coordinates causes some students a.great 
deal of difficulty, we will also discuss the chain rule that is used in making 
these transformations. 


The Laplacian operator 

(31.1) V 2 = ~ + — + — 

cU~ c ly- < ir- 

is probably the most important operator in mathematical physics. The question 
is. what does it mean and why should the sum of three second derivatives have 
anything to do with the laws of nature? The answer to this lies in the fact that 
the Laplacian of a function allows us to compare the function at a point with 
the function at neighboring points. It does what the second derivative did in one 
dimension and might be thought of as a second derivative generalized to higher 
dimensions. Wc now give the basic interpretation of the Laplacian that makes 
it so useful. 
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Interpretations of v= ft, Two Dimensions 

If 

, oi^diST ' han ‘ he av ™** «*« at 

■’• 7 » ! h , e h" "'wV ,l,e °f « a. i.s neighbors 

neighbors " ' h reatcr then the average of u at its 

physics 8 Ke pnncipl “- lve Ml now interpret some of the b asic PDEs o( 

intuitive Meanings of Some Basio Laws of Physios 

The heat equation a = n-^-n m . 

the equation can be interpreted to U meunTh«X re A (<>r COncen,ration) ".and 
concentration) a, (with respect to time) V’ ^ ,n ,em P*rature (or 

temperature at a point is imZZ Zl V-V That is. the 

,he “'™ Se 0f , * m Psnuures on' a arZZnT.Z ££ PO "" * *» - 
The wave equation u - n-V 

of , tirnmhead a„ d c ' m ' ft, inrerpretXt'eM m 3 ,?,?"' ( ™° n f 

On height) than , he amagt „> <*„*“»* 'Ho dntmhead a, that point is 

of ft. neighbors.^For ,0 ,he 

p -t. Figure 3,., illustrates the JlS^ZSX £/ <*• J. 


FIGURE 31,1 Intuitive meaning 
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Poissons equationV-u = /, where /is a function that depends only on the space 
variables (can be a constant: can describe a number of phenomena). 

1. Tii = -p describes the potential of an electrostatic field where p represents 
a constant charge density. What would be the nature of the potential field now 
that you know the meaning of the Lapiacian? 

2. 7 2 u = -g(x,y) describes the steady state temperature u(x,y ) due to a heat 
source g(x,y). If ^(jc.y) is positive at a point, then heat is generated at that point. 
Negative g(ar.y) means that heat is absorbed. 

3. \7 2 m + \u = 0 is known as the Helmholtz equation (or the reduced-wave 
equation), which describes (among other things) the fundamental shapes of a 
stretched membrane. It’s the equation we get when the time factor is separated 
from the wave equation or heat equation. 

So far, we've talked about the intuitive meaning of the Lapiacian 

V 2 // = (Two dimensions) 

V 2 u = m„ + if,.,. + u ; . (Three dimensions) 

However, in many problems, it is necessary to write this equation in other 
coordinates. For example, if the boundary of the region is a circle, then we must 
us & polar coordinates (r,0). while if we are in three dimensions and our boundary 
is a sphere, then we turn to spherical coordinates (r, 0, d>). So the question be- 
comes; how do we rewrite the Lapiacian in different coordinate systems? 

Before we start, however, let’s review briefly the five major coordinate sys- 
tems in two and three dimensions; they are 

Cartesian system in two dimensions 

Cartesian system in three dimensions 

Polar coordinates (two dimensions) 

Cylindrical coordinates (three dimensions) 

Spherical coordinates (three dimensions) 


Polar coordinates are defined by 
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Changing Coordinates ] 

We are now ready to change coordinates. As an illustration, we see how the j 

two-dimensional Laplacian is transformed into polar coordinates. If we under- j 
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stand this, then we should be able to change from any coordinate system to 
another. So, we begin with 

V-u = u tt + Uvy 

To find the new Laplacian, we begin by drawinu the diagram shown in 
Figure 31.2. 



FIGURE 31.2 Functional dependence of u on (r,6] and (x.y), 

The purpose here is to illustrate exactly what depends on what. For example 
the diagram in Figure 31.2 illustrates that the variable u depends on the two 
new variables r and 0 and each, in turn, depends on * and y (lines, illustrate 
dependence). We could also have drawn the diagram with r and 0 at the bottom 
but since we want to derive expressions for u xx and « this diagram is the most 
-appropriate. So, 'how do we find «„ and u yy in terms of r and 0 ? 

It’s really very easy; we first compute u x and u y . We find u x by adding tip the 
paths in our diagram from u to x. In this case, there are two paths, so our 
answer is 

W., = U/ x + M„0 t 

= u r (cos 0) - i/„(sin 6/r) 

The chain rule tells us to multiply the links of the paths tosether and add 
them up. w 

By a similar argument, we have 

u y = u/ y + «„0 v 

= u, (sin 0) + u 0 ( cos 0/r) 

Now for the second-order derivatives. We’ll find u xy first (u.. Will be 
(Figure^rV 01 ^ thC rCader) ' FirSt ' however - let 's draw another’ diagram 
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FIGIK 313 Functional dependence of u, an M) and (*„. 


u-uj unu ^,/j. 

*« if u depends on r and 0 (which, in 
variables. So, with that, we have * ^ depend (,n general) on the same 

Kcose - “-sine - «*sinWr - u.coie/rX-sins/rj 


By a similar argument, we get 


. «,v - («„ sin 0 + M „ cos 0/r - cos 0/r 2 ) sin 0 + 

(u r „ sin 0 + u cos 0 + // roc A/- 

“ cos 0/r - «„ sm 0/r) (cos 0/r). 


Adding u xx and u yyt we get the desired result 


the Laplacian ’in caneT^ “™ e '"tuitive meaning as 

has variable coefficients , so equations inTOlin^" 1 f 0 ™' Unfortuna tely it 
difficult to solve. q nS ,nvolv,n S the polar Laplacian are more 

Carrying out a similar analysis for the three-dimensional Laplacian 
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Changing to cylindrical coordinates, we can show 



Finally, if we write the. Laplacian in spherical coordinates , we have 



NOTES 

1. The Laplacian in cartesian coordinates is the only one with constant coef- 
ficients. This is one reason why problems in other coordinate systems are 
harder to solve. It is still possible to use the separation of variables method 
for these equations with variable coefficients; it’s just that some of the 
resulting ordinary differential equations have variables coefficients. We ar- 
rive at a lot of fairly complicated equations, such as Bessel’s equation, 
Legendre’s equation, and other so-called classical equations of physics. To 
solve these equations, we must -resort to infinite-series solutions and, in 
particular, the method of Frobenious. 

2. There are many more coordinate systems than the ones we’ve mentioned. 
For example, the vibration of an elliptical drumhead would require writing 
the Laplacian in an elliptical coordinate system. Rather than do this, how- 
ever, there is another approach: transform the ellipse into a region more 
to our liking (like a circle). We then solve the transformed problem into 
our new coordinates (polar coordinates) and then transform into the original 
coordinates. 

PROBLEMS ' 

1. What is the wave equation u„ = a ; V 2 w in spherical coordinates if you know 
the solution u depends only on r and f? 

2. What is the wave equation u„ = ct 2 V 2 u in polar coordinates if the solution 
u depends only on r and /? 

3. What is Laplace’s equation V 2 h = 0 in polar coordinates if u depends only 
on /•? What are the solutions of this equation? These are the circularly 
symmetric potentials in two dimensions. 

4. What is Laplace’s equation in spherical coordinates if the solution u depends 
only on r? Can you find the solutions ot this equation? These are the spher- 
ically symmetric potentials in three dimensions. 
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5. VVhai can you say about the surface u(x.y) = xy'! 

6. Transform the three-dimensional Lapiacian V-'j/ = -r - «... to spher- 
ical coordinates. 


OTHER READING 

fpiihc Senes and Onhofimai hmetu-r.s by H. F. Davis. Allyn and Bacon. !9(v; Dover. 19*9. An 
excellent text, written from an intuitive viewpoint; gives the reader the between-the-iines descrip- 
tion of many concepts. 
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LESSON 32 

General Nature of Boundary- 
Value Problems 


I PURPOSE OF LESSON: To explain how PDEs that don’t involve the 
time derivative occur in nature. These differential equations have no initial 
conditions like the hyperbolic-wave equation and the parabolic-heat equa- 
tion. but only boundary conditions. For that reason, these problems are 
called boundary-value problems (BVPs). 

The three most common types of boundary conditions (BCs) are: 

1. BCs of the first kind (Dirichlet BCs) 

2. BCs of the .second kind (Neumann BCs) 

3. BCs of the third kind (Robin BCs) 

These are explained and examples are shown to illustrate these ideas. 


Until now, the problems we’ve discussed involved phenomena that changed over 
space and time. There are, however, many important problems whose outcomes 
do not change with time, but only with respect to space. These problems, for 
the most part, are described by elliptic boundary-value problems, and it is the 
purpose of this lesson to describe these types of problems. 

There are two common situations in physical problems that give rise to PDEs 
that don't involve time; they are: 

1. Steady-state problems 

2. Problems where we factor out the time component in the solution 
First, let's look at steady-state problems. 


Steady-State Problems 

Suppose we look for the steady-state solution (solution when (-* *-) of the heat 
equation 

u, = cr’V-i, 
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It's obvious if the solution doesn't chan i*r in lime, then u, - I). and m> the heal 
equation is reduced to Laplace's equation 


To illustrate the concept of the steady state in detail, let's consider the problem 


PDE n, = u„ i- sin Ur) 0 < .v < I I) < t < a 


(32.1c' BCs 


f n(0./) = 0 

\u(\.t) = 0 


I) < i < K 


IC u(.v.U) = sin ( 3 tt.v) 0 *s ,v =£ 1 


To find the steady-state solution tt(.v.*) (if it exists), we let it, = 0 and solve the 
boundary-value problem 

. = - sin (ir.r) 0 < .v < 1 

<t(0) = 0 
«(1) = 0 

In this case, we have the solution 


m(.v.*) = 33 sin (ir.r) 


If we solved problem (32. 1 ). we would get a solution that was initially sin ( 3-rr.v ) 
but gradually looked more and more like 

1 . 

33 sin Ur) 


. I* or some problems, a zero steads -state solution mat not exist, and for others, 
the steady state may be a sinusoidal function and. hence, it is not always valid 
to set n,. u„. . equal to zero. We should really know something it bout the 

physics ot the problem. 


Factoring out the Time Component in Hyperbolic and 
Parabolic Problems 

In the circular drumhead problem 

u„ = 7 ()€/•< 1 
u = 0 On the circle 

} ti(r.U.<>) = /( r. H ) 

= t?(r. 0) 

we looked for solutions of the form //(/. tj./) = U(r.H)TU). which yielded the 
Helmholtz boundary-value problem 

PDE 7 -U - \ : U = l) 

BC U( l.H) = 0 

This situation is common in PDEs where the solution represents a shape factor 
U(r,Q) multiplied by a time. factor T(t). As a matter of fact, w-e arrive at this 
same Helmholtz equation by factoring out the time component in the heat 
equation 


PDE 

BC 

ICs 


u, = 7-ti 

When studying boundary-value problems (BVPs). there are three types of 
BCs that are most common; we discuss these three types now. 


The Three Main Types of BCs in Boundary-Value 
Problems 

Boundary-Value Problems of the First Kind (Dirichlet Problems) 

Here, the PDE holds over a given region of space, and the solution is specified 
on the boundary of the region. An example would be to find the steady-state 
temperature inside a region when the temperature is yiven on the boundary. 
Another situation would be to find the potential inside the region when the 
potential is given on the houndur. . other example-, follow 

Examples of Dirichlet Problems 

Consider Laplace's equation inside a circle with the solution given on the 
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boundary 


PDE u„ -u, - ~.u m = 0 0 < r < 1 

BC u( l.H) = sin h 0 ^ e< 2~ 

Sec Figure 32.1 



FIGURE 32,1 Interior Dirichlet problem. 

Another example would be an exterior Dirichlet problem in which we are 
looking for the solution of Laplace's equation outside the unit circle, and the 
solution is given on the circle (Figure 32.2). 



FIGURE 32.2 Exterior Dirichlet problem. 

Dirichlet problems are common in electrostatics when we want to find the 
potential in a region with the potential given on the boundary. 

Boundary-Value Problems of the Second Kind (Neumann 
Problems) 

Here, the PDE holds in some region of space, but now the outward normal 
derivative du/dn (which is proportional to the inward flux), is specified on the 
boundary. These problems are common in steady-state heat flow and electro- 
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statics, where the flux (in heat energy, electrons, and so forth) is given over the 
boundary. 

For example, suppose the inward flow of heat varies around the circle ac- 
cording to 



The steady-state temperature inside the circle would then be given by the solution 
of the BVP 

V 2 m = 0 0. < r < 1 


— = sin 0 r = 1 0 « 6 < 2tt 

dr 

Here, we can see (Figure 32.3) that the flux of heat (cal/cm sec) across the 
boundary is inward for 0 0 < it and outward for n « 0 < 2-jt. 



FIGURE 32.3 Flow of heat for the Neumann problem. 
However,- since the total flux 

l ~dr^ = l S ‘ n 9 d® ~ 0 
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boundary 


» 


PDE U„ + + = 0 0 < r < l 

BC u(l,0) = sin 0 0 « 0 < 2ir 

See Figure 32.1 



FIGURE 32.1 Interior Dirichlet problem. 

Another example would be an exterior Dirichlet problem in which we are 
looking for the solution of Laplace’s equation outside the unit circle, and the 
solution is given on the circle (Figure 32.2). 



FIGURE 32.2 Exterior Dirichlet problem. 

Dirichlet problems are common in electrostatics when we want to find the 
potential in a region with the potential given on the boundary. 

Boundary-Value Problems of the Second Kind (Neumann 
Problems) 

Here the PDE holds in some region of space, but now the outward normal 
derivative duldn (which is proportional to the inward flux) is specified on the 
bouS". Thee problems are common in steady.,, ,,= hea, flow and elec., 0 - 
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statics, where the flux (in heat energy, electrons, and so forth) is given over the 
“Sample, suppose the inward flow of hea, varies around the circle ae 
cording to 



The steady-state temperature inside the circle would then be given by the solut.on 
of the BVP 

= 0 0 < r < 1 

- = sin 0 ' r = 1 0 ^ 0 < 2n 

dr 

Here we can see (Figure 32.3) that the flux of heat (cal/cm sec) across the 
boundary is inward for 0 ^ 0 < it and outward for tr < 0 < 2ir. 



FIGURE 32.3 Flow of heat for the Neumann problem. 
However, since the total flux 


j*’ y/0 = J () sin 9 c/0 = 0 
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(a condition that must always he true for Neumann problems), we can say that 
the temperature at each point inside the circle does not change with respect 
to time. 

In other words. Neumann problems make sense only if the net gain in heat 
(or whatever) across the boundary is zero. Mathematically, this says that 


must be true around the boundary or else the problem has no solution. For 
example, the interior Neumann problem 

~ : it = tl 0 < r < 1 

“(l.H)=l r = 1 0 =s 6 < 2- 


has no physical meaning, since the constant inward flux of one would not give 
rise to a steady-state solution. 

The Neumann problem is somewhat different from other boundary conditions 
in that solutions are not unique. In other words, the Neumann problem 

V : h = 0 0 < r < 1 

^ (1.6) = cos (26) r = 1 O s 6 < 2-rr 

(note that the total flux across the boundary is zero) has an infinite number 
of solutions h(;-.0). However, once we have one solution, we can get the 
others just by adding a constant. For example, one solution to our Neumann 
problem is 

Hi’. 6) = tr cos (26) 

and ii is obvious that if we add a constant to this solution, another one is 
obtained. For this reason, if we want to find one solution to the Neumann 
problem, we must have some additional information (like knowing the solution 
at one point). 

Boundary-Value Problems of the Third Kind 

These problems correspond to the PDEs being given in some region of space, 
hut now the condition on the boundary is a mixture of the first two kinds 


i 

1 : 
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where It is a constant (input to the problem) and g a given function that can 
vary over the boundary. A more suggestive form of this BC' would be 

— = - Hn - g) 


which says the inward flux across the boundary is proportional to the difference 
between the temperature u and some specified temperature g. This has the 
interpretation that 

1. If the temperature it (on the boundary) is greater than the boundary 
temperature, then the flow of heat is outward. 

2. If it is less than the boundary temperature g. then heat flows in. 

This, of course, is just Newton's law of cooling, and so these types of BCs are 
very natural in steady-state heat flow. 

Example - - 

Suppose the temperature directly outside the unit circle is given by g(0) = sin 
6. In this case, the flow of heat across the boundary would be given by 

j- = - h(u - sin 0) r - 1 0 0 < 2v 


and; hence, to find .the steadv-state heat inside the circle, we would have to solve 
the B VP 

PDE : V*K = 0 0 < r < 1 

(32.2) 

BC + h(u - sin 0) = 0 0 « 0 < 2ir 

dr 

The constant h is a physical parameter and measures the amount of flux across 
the boundary per degree difference between u and sin H (it's difficult to measure, 
since it depends on the interface across the boundary). If It is large, then heat 
flow is great per temperature difference, and so the solution looks verv much 
like the solution of the Dirichlet problem with BC g = sin ti. On the other hand, 
if It - 0. then the BC is reduced to the insulated BC 


The reader can imagine how the solutions to problem (22.2) could change as 
h goes from 0 to x. When It = (). the boundary is completely insulated, and. 
hence, the solution u(r.O) is a constant (the solution is not unique here, and any 
constant will work). As It gets larger and larger, the solution looks more and 
more like the solution to the Dirichlet problem with BC u = sin 6. When h 


General Nature of Boundary-Value Problems 259 


> 0, but close to zero, the solution will be almost identically zero (which is the. 
average of sin 0 on the boundary). 

PROBLEMS 

1. Based on intuition, can you find the solution to the Dirichlet problem 

PDE 7 2 u = 0 0 < r < 1 

BC t<( 1 ,0) = sin 0 0 « 0 < 2rr 

2, Does the following Neumann problem have a solution inside the circle: 

PDE 7 2 u = 0 0 < r < 1 

BG = sin 2 0 

dr 


3. For different values of. A; imagine the solution n(r,0) to 


PDE 7 2 u = 0 0 < r < 1 

" • du 

BC — + h (u - sin 0) = 0 


4. What BVP would you solve to find the steady-state solution of 


PDE 

BCs 

ICs 


u(0,i) = 0 ' 

u(l,t) = 0 



f «(x,0) = sin (3ir;r) 

W*.0) = 0 



< 1 


0 < t < X 


5. Now that you know the physical interpretation of the Laplacian. what is the 
general nature of solutions of the Helmholtz BVP 

PDE 7 ht = -\ 2 u ()'</■< 1 

BC ii( 1,0) = 0 0 s 0 < 2rr 
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6. What is the. physical interpretation of the following mixed BVP inside the 
square 

PDE «„ + = 0 0 < a- < 1 0 < y < 1 


BCs 


u v (x,0) - h\a(x,0) - 2| = 0 
u(x, 1) = 1 
M,((),y) = 0 


0 < ,r < 1 
0 < y < 1 


OTHER READING 

Partial Differential Equations of Mathematical Physics by Tyn Mvint-U. Elsevier, 1973. 
Chapter 8 of this text contains an excellent problem set for boundary-value problems. 
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LESSON _33 

Interior Dirichlet Problem for a 
Circle 


PURPOSE OF LESSON: To show how to solve the interior Dirichlet i 
problem for the circle 

PDE u„ + -tr, + 4/„„ = 0 (I < ;• < 1 
- BC n ( I .H) = g(th ' 0 < fl < 2v 

by separation of variables. The solution can be interpreted as expanding the 
boundary function as 

g(0) = X cos («0) + b„ sin («0)] i 

and then finding the solution to each of the problems ■ 

V : u = 0 ? : tr = (I 

m( 1 .0) = sin (rtO) k( 1.8) '= cos (h0) 

Since these two problems have solutions 

i/(r.O) = r" sin (/ 10 ) td/.H) = r" cos (/I0) r- • 

the solution to the interior Dirichlet problem is 

u(r.U) = X r "[ a r cos ( 'i0) + />„ sin f/iB)j 

After this series is obtained, some algebraic manipulations are performed 
to arrive at an alternative integral-form of the solution. This new form, the 
Poisson integral solution, brings out some interesting ideas. 
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This lesson presents a number of new ideas as we solve the Dirichlet problem 


(33.1.) 


PDE (,„ - i„, * i,,„„ » d (| 
BC' i/(l. ft) = g(H) (l -v- (I < 2- 


The method of separation of variables w ill be the usual procedure, but alter we 
itnd this series solution, we then manipulate it to act an alternative formulation 
( Poisson integral formula). 

Problem (33.1) is very important in physical applications. It can be interpreted 
as tinding the electrostatic potential inside a circle when the potential is men 
on the boundary. Another interpretation is the soap film model. If we start" with 
a circular wire hoop and distort it so that the distortion is measured bv p(0) and 
dtp ,t into a soap solution, a film of soap is formed within the wire. The height 
of the film is represented by the solution of problem (33.1). provided the dis- 
placement g(0) is small. 

The reader should be well aware of the separation-of-variables technique 
outlined in Figure 33.1 and should work out the details (problem 1). 

A few comments on the outline in Figure 33.1 



FIGURE 33.1 Outline of the solution for the interior Dirichlet problem. 
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'• J,tr d t T ShOUld ; e : ,t > ,hat the separation constant must be nonnegative 
i hat s w hy it s called K 2 ). If the separation constant were negat'vf the 
function 0(0) would not be periodic, while, on the other hand 8 if it were 
, !! • We . WOU ' d t , f ’ row out tfie ln ' term in solution R(r) = a + b In , 

The reader should know how the constants a„ and b„ were obtained 
To summarize, the solution to the interior Dirichlet problem (33.1) is 



vadont WC reWHte SOlUti0 " in the a ‘ternative form, let’s make some obser- 

Observations on the Dirichlet Solution 

L The interpretation of our solution (33.2) is that we should expand the 
boundary function g(Q) as a Fourier series 

8(&) = 2 K cos (/i6) + b„ sin (n0)] . 

Pr0 ?‘ em cosine in the series. Since 

each of these terms will give rise to solutions e- sin M) and r cos („9) 
we can then say (by superposition) that • ’ 

“( r - e ) = Z r“[a„ cos (/i0) + b„ sin (n0)] 

2. The solution of 

PDE 7 2 u = 0 0 <; r < l 

BC «(1.B) = 1 t sin 0 + | sin (30) + cos (40) 

would be 

u(r.B) = 1 + r sin 0 + £ sin (30) + r 4 cos (40) 

Here, the i»(0) is already in the form of a Fourier series, with 
*■“». b t - I 

~ 1 by = 0 . 5 . 

All other a„’s = 0 All other b;' s = 0 
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This last equation is what we were looking for: it's the Poisson Integral Formula. 
So what we have is an alternative form for the solution to the interior Dirichlet 
problem 



Observations on the Poisson Integral Solution 

1. We cttii interpret the Poisson. integral solution (33.3) as finding the po- 
tential it at (Ml) as ti weighted average of the boundary potentials g { 0 1 
weighted bv the Poisson kernel 


Poisson kernel = 


IV - r 

R : - 2rR cos (H - a ) + r 


This tells us something about physical systems: namely, that the potential 
at a point is the weighted average of neighboring potentials. The Poisson 
kernel tells just how much weight to assign each point (Figure 33.2). 



FIGURE 33.2 u(r,e) as a weighted sum of boundary potentials. 


For boundary values g( a) close to (r,0). the Poission kernel gets large. 
since the denominator of the Poisson kernel is the square of the distance 
from (r.fl) to (R.a) (Figure 33.2). Due to this fact, the integral puts more 
weight on those values of g(a) that are closest to (r,0). Unfortunately, 
if (r.6) is extremely close to the boundary r = R. then the Poisson kernel 
gets very large for those values of a that are closest to (r.0). For this 
reason, when (/•.()) is close to the boundary, the series solution works 
better for evaluating the numerical value of the solution. 
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1 r po,o '" i “' - «•>• -he 

«<«>•<•> » d; ['nO 

in other words, the potential at the center ol the circle is tlv ......... . , 

the boundary potentials. 1 u 

This completes our discussion. Offhand, the reader mav think that this isn’t 

' '' ILTm- CaS f'u‘ hC ° Xpurimcn,cr designs the physical apparatus and has 
the option of shaping the boundary any way he or she likes 

wh!rh°n WC Wl11 Stud - V bansformations known as conformal mannings 

NOTES 

1. : We can always solve the B VP (nonhomogeneousPDE) 

PDE V : // = f inside O' 

" = On the boundary of 0 

by 

(a) Finding any solution V of V : V = / ia ,, , , . 

(h) Solving the new BVP ' (A P‘' r «'a"ar solution) 

= 0 Inside O 

W ~ 1 On the boundary of D 
(c) Observing that u = V - w is our i . 

brother words, we can transfer the nonhomogeneity bom", he PDE to the 

2. We can solve the BVP (nonhomogeneous BC) 

PDE V-,< = ti in^. i) 

^ 11 = f On the boundary of l) 
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■by 

(a) Finding anv function V that satisfies the BC V - /on the boundary 
of D 

(b) Solving the new BVP 

V 2 W = V'-V Inside D 
W = 0 On the boundary of D 

(c) Observing that u = V - W is the solution to our problem 

In other words, we can transform the nonhomogeneity from the BC to the 
PDE. 


PROBLEMS 

1. Carry out the details for the separation-of-variables solution to the interior 
Dirichlet problem (33.1). It’s very important to know the details, since when 
we solve other Dirichlet problems in the next lesson, there will be some very 
interesting differences. You should especially know why the separation con- 
stant X cannot be negative. Also when X = 0, an important solution is 
thrown out; what is it? Look at the outline in Figure 33.1. 

2. What is the solution to the interior Dirichlet problem 

PDE u rr + -u r + ~u m = 0 0 < r < 1 

with the foilwing BCs: 

(a) u(l,0) = 1 + sin 0 + - cos 0 

(b) u(l,0) = 2 " ... 

(c) ii(1.0) = sin 0 

(d) u(1.0) = sin 30 

What do the solutions look like? Do they satisfy Laplace’s equation? 

3. What is the solution to the following interior Dirichlet problem with radius 
R = 2 : 

PDE V-u = 0 0 < r < 2 

BC »(2.0) = sin rt 0 0 < 2 tt 

What does the graph look like? 

4. What would be the solution of problem 3 if the BCs were changed to ii(2.«) 
= sin (20)? What does this graph look like? 
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5. Solve 

PDE 
BC 

Roughly, what does the solution look like? 

6. What does the Poisson kernel look like as a function of a: l) « a < 2 tt for 
r = 3R/4, 0 = tt/ 2? In other words, draw the graph of the Poisson kernel. 

7. Verify note 1 in the lesson. 

8. Verify note 2 in the lesson. 

OTHER READING 

Partial Differential Equations: An Introduction by E. C. Young. Allvn and Bacon. 1972. 
This text has a nice discussion on the Poisson integral formula. 



Interior Dirichlet Problem for a Circle 269 


LESSON 34 

The Dirichlet Problem in an 
Annulus 



There are many regions of interest where we might solve the Dirichlet problem 
Just to name a few. we could have the Dirichlet problem: 

(a) Inside a circle (Lesson 53 ) 

(b) In an annulus (this lesson) 

(cl Outside a circle (this lesson) 

(d) Inside a sphere (later) 

(e) Between two spheres (later) 

. I Between two lines (in two dimensions) 

(g) Between two planes (in three dimensions) 

The list is endless. Our intention is to solve a representative sample of Dirichlet 
problems, so that the reader learns the general principles and is able to solve 
new ones on his or her own. 

The goal in this lesson is to find the shape of a soap film between two warped 
hoops. Our intuition is probably not so good here as it was in the interior 
Dirichlet problem. The model for this problem is 


(34.1, PDE + o R,<r<R._ 



FIGURE 34.1 Laplace's equation in an annulus. 


The problem here is to find the solution u(r.Q) between the two circles r = 
, 1 and /• = R : . which is given as g,(0) and g ; (0) on the circles'. We beein bv 
looking for solutions of the form ■ 

«(/•.«) = R(r) 0(0) 
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Substituting this into Laplace’s equation, we get the two following ODEs in R(r) 
and 0(0); 

r 2 /?" + rR' - \}R = 0 (Euler’s equation) 

9" + \ 3 e = o 

Note that in the two equations, we required the separation constant to be greater 
than, or equal to, zero (we’ve called it X 2 ), or else the solution for 0(6) would 
not be periodic. The next step will be to solve these two ODEs and multiply 
their solutions together. This will give us our solutions to the PDEs that are of 
the form R(r)0(0). 

.The more interesting of the two equations is Euler’s equation. Fortunately, 
it is one of the few ODEs with variable coefficients that can be solved fairly 
easily. To find the solution, it is best to consider two cases. 

SOLUTION OF EULER’S EQUATION (r*R" + rR' - X 2 /? = 0) 

CASE 1 (X = 0) Here Euler’s equation reduces to 

i^R" + rR' m 0 

and it is easy to see that the general solution is 

R(r) = a + b In r 

This can be found by letting V(r) = R‘(r) and solving the new equation 
rV'(r) + V(r) = 0 

for K(r). After finding V{r) = cjr (use the ODE technique of separation of 
variables), we substitute back to get 

R{r) = c, In r + c 2 

CASE 2 (X > 0) Here Euler’s equation is 

rR" + rR' - \ 2 R = 0 

and to solve this, we look for solutions of the form R{r) = r a . The goal is 
to find two values of a (say a, and a 2 ) so that the general solution will be 

R(r) = ar a ' + br“- . 

Plugging R(r) = r a into Euler's equation yields a = X, -X and, hence, 

R(r) = ar * + br~ x 
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Using this solution to Euler’s equation, we now have 


R(r) = a + b In r 
|0(0) = c + dQ 


[0(0) = c cos (X0) + d sin (X0) 

and using the requirement that 0(0) must be periodic with period 2 it, we hav 
that X must be 0, 1, 2, .... Hence, we arrive at the following solutions t 
Laplace’s equation: 


Product Solutions to Laplace’s Equation 


cr" cos (n0) 
cr n sin (n0) 
cr~ K cos (nfl) 
cr~ n sin (n6) 

Since any sum of these solutions is also a solution, we arrive at our general 
solution 


w ( r ' 0 ) = a » + Mn r + 2 [(“ f + V) cos (n0) 

(34.2) -.-I 

+ \c„r" + d„r~") sin (n0)] 

to Laplace’s equation. 

The only task left is to determine the constants in the sum (34.2) so that 
u(r,0) satisfies the BCs 

«(*..«) = 5 ,( 0 ) 
u(R ; ,0) = g 2 (0) 

Substituting the above solution (34.2) into these BCs and integrating gives the following 


a„ + b„ In /?, = — g ; (5) ds 
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(34.3) | J i-2-rr (Solve for «„./>„) 

a,.R'i - b r R~" = 3 g ; (s) cos (ns) ds 


c„R - + £/„/?,"’ = - g : (i) sin (nr) ds 


From these equations, we can solve for the constants a„. b„. a„, b„. c„. and d„. 
We've now solved problem (34.1). The solution is (34.2), where the constants 
are determined by equations (34.3). 

We will work a few simple problems in order to give the reader a feeling for 
this solution. 


Worked Problems for the Dirichlet Problem in an 
Annulus 


Example 1 

Suppose the potential on the inside circle is zero, while the outside potential is 
sin 6 

PDE V 2 u = 0 1 < r < 2 . 

BCs {$:!>: L. osea2 ’' 

The first step in computing the solution is to compute the integrals in equations 
(34.3). Carrying out these simple calculations and solving the necessary equations 
for o„, b u . a„. b„. c„. and d„ yields: 


n = 1 

all other n's 


-2/3 n = 1 

| 0 all other n 
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These values give the solution as 



We can easily check that «(r.0) satisfies the two BCs. It's obvious that it satisfies 
Laplace's equation, since it is in the form of the general solution (34.2). 

Example 2 

Consider the problem with constant potentials on the boundaries 



In this case, we can -save ourselves a lot of lime, since it's obvious that the 
solution is independent of 0 (since the BCs are independent of 0). In other 
words, we know our solution must be of the form tr n + 6 0 In r. Using our two 
equations for a 0 and h 0 , we obtain 


a 0 + h 0 In 1 = 3 
a 0 + b 0 In 2 = 5 


a„ = 3 b 0 = 2/In 2 = 2.9 

Hence, the solution is 

u(r,0) = 3 + 2.9 In r 
The graph of this solution is given in Figure 34.2. 



FIGURE 34.2 Radial slice of the potential .inside the annulus (1 < r< 2). 
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Example 3 

Another interesting problem is 


PDE V-u = () 1 < r < 2 


BCs 


u( 1,0) = sin 0 
/<( 2,0) = sin 0. 


Exterior Dirichlet Problem 

The exterior Dirichlet problem 

PDE u„ + -u, + -ji, m = D 1 < r < * 
BC ff(1.0) = g(0) ()«Hs2rr 


A quick check of the coefficients a„, b„, a„, b„, c„, and d„ reveals that they are 
all zero except for c, and d t . In fact, the equations for c, and d, are 

c, + d, = - J u sin 2 5 ds = 1 

2c, + d,/2 = ~ J u sin 2 s ds = 1 

Solving for c, and d, gives c, = 1/3 and d, = 2/3. Hence, the solution is 


is solved exactly like the interior Dirichlet problem in Lesson 33 except that now 
we throw out the solutions that are unbounded as r goes to infinity. 

r cos («0) r" sin (n0) In r 

Hence, we are left with the solution 

(34.4) 

where a„ and b„ are exactly as before 


«(r.0) = 'Zr- n [a n cos (n0) + b„ sin (n0)] 



2-it 


g(0) rfe 


The shape of this curve for different values of 0 is shown in Figure 34.3. 



a n = - Jf g(0) cos (n0) d0 b„ = ~ g( Q ) s ' n (” e ) 

In other words, we merely expand m( 1,0) = g(0) as a Fourier series 

g(0).= -X [a„.cos (nd) + b„ sin (n0)] 

and then insert the factor r~" in each term to get the solution. 

To gain a little familiarity with this solution, two examples are given. 

Examples of the Exterior Dirichlet Problem 

Example 1 

The Exterior Problem: 


We finish this lesson with a short discussion of the Dirichlet problem outside 
the circle. 


PDE V 2 u = 1) l < r < '• 

BC ii(1.0) = 1 + sin 0 - cos (30) 0 < 0 < 2 tt 
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has the solution 

u(r,0) = 1 - - sin 0 + 3 S * 11 (30) 

Example 2 

The Exterior Problem: 

PDE V : w = 0 1 < r < x 

BC u(r.Q) = cos (40) 0 « 0 =s 2 tt 

has the solution 

u(r.0) = ”j cos (40) 

The reader should envision what this solution looks like. 

NOTES 

1. The exterior Dirichlet problem for arbitrary radius R 

PDE V : « = 0 R < r < x 
BC u(R.Q) = g(0) 0 0 =£ 2 it ■ 

has the solution 

u(r, 0) = 2 (r/R)"‘ k cos (/10) + b„ sin (r?0)] 


The only solutions of the two-dimensional Laplace equation that depend 
only on r are constants and In r. The potential In r is very important and is 
called the logarithmic potential: it will be discussed in more detail later. 


PROBLEMS 

1. Solve the Dirichlet problem 

PDE V : « = 0 1 < r < 2 


BCs 


fu(l.e) = COS 0 
|u(2,0) = sin 6 


What is the solution to the exterior Dirichlet problem 


PDE V : u = 0 1 < r < x 
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for the following BCs: 

(a) = I 

(b) u(1.0) = 1 + cos (30) 

(c) w(1.0) = sin (0) + cos (30) 

^ “ ne > -{0 

3. The exterior Semutnn problem 

PDE = 0 1 < r < x 

BCs ^ (1-.6) = g(0) 0 =s 6 « 2 tt 

has a solution that is the same form as the Dirichlet problem 

- - • “M) = X cos («0) + b, sin (h0)] 

but now the coefficients a„ and b„ must satisfy the new BC. Substitute this 
solution in the BC 

du 

— (1,0) = sin 0 

in order to obtain the solution to 

V J u = 0 1 < r < w 

du 

— (1,0) = sin 0 

Does your solution check? Of course, once you have this solution, any 
constant plus this solution is also a solution. 

4. Substitute the general solution (34.2) into the BC 

«(*..») - g,(8) 

«(*»«) = &(0) 

and integrate to get equations (34.3). 


OTHER READING 

Partial Differential Equations by Tyn Myint-U. Elsevier, 1973. An excellent discussion 
of the Dirichlet problem; many problems are worked out. 
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LESSON 35 

Laplace's Equation in Spherical 
Coordinates (Spherical Harmonics) 


PURPOSE OF LESSON: To find particular solutions of Laplace's 
equation in spherical coordinates, so that they can be fitted together in 
various wavs to solve different problems (like Dirichlet, Neumann, for 
example). We will also solve the interior Dirichlet problem 

PDE (rtt,), + -r — 7 ( s > n <•> "*L + u m .= 0 
sin <b 1 sim <b 

BC it(l,0,<b.) = g(6) 0^d>«iT 

for the special case where the boundary potential g(4>) depends on/v on <j> 
(the angle from the north pole). Here, we expand the boundary potential 
g(d>) as an infinite series of surface harmonics 

g(<b) = S a „P,X cos (J>) 

where the surface harmonics P„(cos d>) (called Legendre polynomials) are 
all particular solutions to Laplace's equation and are polynomials in cos <!> 
of degree n. After finding this expansion, the solution is just 

M(/-,d>) = V <U-"P „(cos (b) 

The analogous exterior Dirichlet problem has the solution 
(((/-.(b) = V ~7 /*„(cos (b) 


An important problem in physics is to find the potential inside or outside a 
sphere when the potential is given on the boundary. For the interior problem. 
we must find the function u(/-,B,cb) that satisfies 
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I 



' PDE (>•?«,), +'-r— r [sin 6 m*|* + ~ W = » 

. sin <b sin- <b 

(35.1) 

BC u(l,0,<b) = g(0.<b) -Tt *5 9 « TT l) « (b « IT 

Note that this spherical Laplacian is written in a different form than those we've 
seen before. This. forni is slightly more compact and easier to use. 


I 



FIGURE 35.1 Dirichlet problem interior to a sphere. 

• A- typical application of this model would be to find the temperature inside a 
sphere when the.temperature is specified on the boundary. Ouite often g(0,cb) 
has a specific form, so that it isn't necessary to solve the problem in its most 
general form. 

Two important special cases are considered in this lesson. One is the case 
when g(0,<|>) is constant, and the other is when it depends only on the angle <b 
(the angle from the north pole). 


Special Cases of the Dirichlet Problem 


Special Case 1 g(0,4>) = constant) 

In this case, it is clear that the solution is independent of 0 and 6. and so 
Laplace's equation reduces to the ODE 


This is a simple ODE that the reader can easily sobe: the general solution 
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In other words, constants and dr tire the only potentials that depend only on 
the radial distance from the origin. The potential Mr is very important in physics 
and is called the Newtonian potential. We now work two problems where the 
potential depends only on r. 

Problerr- 1 (Potential interior to a sphere) 




FIGURE 35.2 Potential between two concentric spheres each at constant 
potential A and 8. 
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The graph of this potential is given for different values of the boundary potentials 
A and B in Figure 35.2. 

Special Case 2 [g(e,4>) depends only on ch] 

Here, the Dirichlet problem takes the form 



BC h( 1.8.<|>) = g((j>) 0 cb « it 

Using separation of variables, we look for solutions of the form 
u(r, 4 >) ^ ’ 

and arrive at the two ODEs 

rR" + 2rR' - n(n + 1)K = 0 (Euler's equation) 

[sin <i> <!>']' + « (n -t- 1) sin 4> <t» = 0 (Legendre's equation) 

The separation constant is chosen to be n(n + 1) for convenience; the reader 
will see shortly why this choice is made. 

We now solve Euler’s equation by substituting /?(!•) = r° in the equation and 
solving for a. Doing this, we get two values 

a {-(« + !) 

and, hence, Euler’s equation has the general solution 
R(r) - ar + 

Legendre’s equation isn’t so easy; the general strategy in solving this equation 
is to make the substitution 

Making this change of variable gives rise to the new Legendre’s equation 
cP<$> d< t> 

(1 - x 2 ) — - 2x — + 7l(7! + 1)$ = 0 - 1 « Jt « 1 

The idea here is to solve for <I>(jt) and then substitute x = cos <b in the solution. 
Legendre’s equation is a linear second-order ODE with variable coefficients. 
One of the difficulties in this equation is that the coefficient (1 - x 2 ) of eP<P/dx 2 
is zero at the ends of the domain -1 *= x « 1. Equations like this are called 
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Wifhom gSTinto ^ h e ^det af I s 'i ft' t s ° m e di^d '7 ^ b> ’ meth ° d ° f Froben 'us. 
mended reading), we arrt^'I.V ve v n e , ? ference 1 of 'he. reconr- 
solutions of Legendre s equation occur when « = <77 ^ ,° n,y b ° U " ded 

are polynomials P„(x) (Legendre polynomials) ’ these solu,ions 


" = 1 P,{- r) = .r 

" = 2 Pzi*) = \ (3.r - l) 



"7 ^ 2"nl dx n (Rodrigues’ formula) 

The graphs of a few Legendre polynomials are shown in Figure 35.3. ■ 



FIGURE 35,3 Legendre polynomials P n {x ). 

We now have that the bounded solutions of 
r 2R " + 2rR‘ - „Ui f ))/? = () 

¥ n * “*T - n„ - iiMn.bd) = 0 

are 

R(r) = ar“ 
f t>(<t>) = aP n (c os ib) 
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and suppose we would like to find the temperature inside the sphere. In this 
problem, the temperature is constant on circles of constant latitude (for example, 
the equator has temperature 2). To find u. we must solve 

PDE v : u = 0 0 < r < 1 

BC n( 1 .6 .<±> ) = 1 - cos (24) 0 « * =£ " 

See Figure 35.4 lor a graph of the boundary temperature. 



o */2 


FIGURE 35.4 Temperature on latitude circles 4 radians from the north pole. 
Our goal now is to find the coefficients a„ in solution (35.5); to find them, we 
can either 

(a) Use formula (35.4). 

(b) Use existing computer programs that find the coefficients in Legendre 
expansions (see your computer center). 

(c) Use a little common sense. 

Trying the latter, consider the trigonometric identity 

cos (24) = 2 cos 2 (<t>) - 1 

which allows us to write the boundary temperature g(4) as 
1 - cos (24) = 1 - [2 cos 2 (4) - 1] 

= 1 - | (3 cos : (4) ~ 1] + j 

= \ P fl (cos 6) - ^ P z (cos 4) 

This gives us the expansion of g(4) as a series of Legendre polynomials: hence, 
the solution to the problem is 

4 4r 

u(r,4) = -E«(cos 4) - — P 2 (cos 4) 

4 Ir 2 

m 1 - y(3 COS 2 4-1) 
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NOTES 

1. We can see that after expanding the boundary potential g(4) as the series 

g( 4) = "Za n Pn ( cos 4) 

we need only multiply the n-th term by r" to get the solution 
w(r,4>) = '2 / a n r n P„(cos 4) 

2. The solution of the exterior Dirichlet problem 

PDE V 2 u = 0 1 < r < * 

BC u(l,e,4) = g(4) 



For example, the BCg(4) = 3 would yield the solution u(r. 4) = 3 ir. Note 
that in this problem, the solution goes to zero, while in nvo dimensions, the 
exterior solution with constant BC was itself a constant. 
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PROBLEMS 


1. Substitute R{r) = r - into Euler's equal 


r'R" + 2rR‘ - «(„ + |)fl = () 


to find a s n. - (/i + l) 

Make the change of variable. r = cos 6 to change the old Legendre's equation 


(sin 6 ‘l>T + n(n + i) sin 6 <t> = 0 o « & « w 


to the new Legendre's equation in x 


3. Verify Rodrigues' formula 

PAx) = ~ W 

for the Legendre polynomials P,„ P„ />,, and />,. 

4. Solve the interior Dirichlet problem 

PDE = 0 0 < r < 1 

BC i<(l,<i>) = cos (3<|>) 

Use a trig formula to try to write cos (36) in terms of cos 6. cos'- 6, cos 1 6 and 

then combine them to get the expansion 

cos (36) = (cos 6) + «,/», (cos 6) -r . . . 


I" «*<*«. 

(''+ 1 r,vM '.’ r ,h» ICm ,'h hCr 'i lhC b T"‘ l " ry ° f ' hc mmhern h «’"«Ptiere is hot 
( + I), while the southern hemisphere is cold ( - 1). 
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6. What is the solution to the exterior Dirichlet problem 

PDE = 0 l < r < x 

BC t/(1.6) = 1 + cos 6 

Does it check? 


OTHER READING 

Elementary Differential Equations and Boundary-Value Problems bv W. Bovce and R. 
DiPrima. Wiley & Sons, 1969. One of the best ODE textbooks: Euler's. Bessel's, and 
Legendre’s equations are discussed in this book. 



Laplace’s Equation in Spherical Coordinates (Spherical Harmonics) 289 


LESSON 36 


A Nonhomogeneous Dirichlet 
Problem (Green's Function) 


PURPOSE OF LESSON: To show how a nonhomogeneous Dirichlet 
problem can be solved by the Green's function approach (the impulse- 
response function). This important technique resolves the right-hand side 
of the equation (generally thought of as an input of some kind) into a 
continuum of impulses (delta functions or point inputs) at the different 
points of the domain. The response to each of these impulses is then found 
(Green's function or the impulse-response function), and then they are 
summed (integrated) to give the overall response. 


A common problem in applied mathematics is to find the potential in some 
region of space in response to a forcing term f(x,y) acting inside the region. In 
electrostatics, the potential (volts) in a region D is sought in response to a charge 
density f(x,v) throughout that region. A typical example would be to find the 
potential inside a circle in two dimensions that satisfies (Poisson’s equation with 
zero BC) 


PDE u rr + -u, + -,u„ = /M) 

(36.1) ' r 

BC m(1,0) = 0 0 « 0 =? 2- 

Note that we have chosen the boundary values to be zero. If we wanted to solve 
the general case, where both the equation and BC were nonhomogeneous. we 
could add the Poisson integral formula from Lesson 33 to (he solution from this 
lesson. 

In order to gain a little intuition about nonhomogeneous differential equa- 
tions. let's consider graphing the solution to the following Poisson’s equation: 

PDE V : w = -<7 0 < r < 1 (<? a positive constant) 

BC u(l.e) = 0 0 « 0 « 2rr 

Here, the potential (temperature if you like) is fixed at zero on the boundary. 
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and the Laplacian of u is always equal to -q inside the circle. Since V-i i(jp) 
measures the difference between u(p) and the average of its neighbors. Poisson s 
equation says that the surface w(r,0) will always be concave down, so to speak. 
In other words, it will look like a thin membrane fixed at the boundary that was 
continuouslv being pushed up by a stream of air from below. If the right-hand 
side were a function f(x.y) that changed over the domain, then the concavity at 
each point would change. 

We now get to the major part of this lesson: to introduce Green’s function 
and solve equation (36.1). 

First, however, we must introduce the notion of potential due to point sources 
and sinks. 

Potentials from Point Sources and Sinks 

In solving a nonhomogeneous linear equation, it is sufficient to solve the equation 
-with a point -source, since we can find the solution to the general problem by 
summing the responses to point sources. Our goal here is to find the potential 
j in some region of space due to a point source (or sink). We can interpret these 

points in a variety of ways. In heat flow, we could think of a source as a point 
where heat is created and a sink as a point where it is destroyed. On the other 
hand, in electrostatics, a point source would be a single positive charge (proton), 
while a sink would be a single negative charge (electron). In any case, whatever 
the interpretation, we will now find the potential u(r) in two dimensions that 
depends on'a single point source (the potential in three dimensions is left as a 
problem). 

.- Suppose we have a single point source of magnitude + q located at the origin. 

It is clear that the heat (or whatever) will flow outward along radial lines, and, 
hence, if we compute the total outward flux across a circle of radius r. we have 
the situation described in figure 36.1 

Total outward flux across the circle = u,(r)r d§ 

= -2 TiruXr) 



. FIGURE 36.1 Radial flow of heal due to a point source, 
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seneraled W1 , 6ln ,„ e c|rc|e 

-2ir ru r (r) = q 


Solving this simple different, equalion u(r) ^ ^ 



FIGURE 36.2 Potential doe to a pom, source m, 0lm6relons 


on the other hand'isTepreLmed hv , 8 ^ '° 8 (Fi S" re 36.2). A 

magnitude would give rise to a potetitiafK"" ' lnd S ° a sink wilh 



Poisson’s Equation inside a Circle 

We will now solve the important problem 

(36.2) PDE * ±u m - f(r,B) () < , < , 

BC «(>■») “II 0»i««2w 

' • Finding the poiS“g>T|!*| ’’ u [“ef !S >d) 'J’"”*" ° f *“l* 
dtiry and which is due to a single duirgcTmngniuide bt | m 'ej 
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2. Summing the individual responses G(r, 0, p, <t>) weighted by the right-hand 
side (charge density) f(r.B) over all (p.<b) in the circle to get the solution 

u(r,0) = | ( | G(r,0.p.<b)/(p.<b) p </p </<b 
We now find the impulse response G(r,0, p.tb) for our problem. 

Finding the Potential Response G{r, 9,p,<|)) 

We first replace the right-hand side /(r.0) by a point source of magnitude + 1 
at an arbitrary point (p,<b). Mathematically, we call a point source an impulse 
function (or delta function) and represent it by 6(r - p.0 - <b). We interpret 
this delta function as a function of r and 0 that is zero for all points except at 
(p,<b), where the unit charge is located. In terms of forces, we could interpret 
the delta function as a point force of magnitude + 1 at (p-d>)- The idea now is 
to find the potential response (which we force to be zero on the boundary) due 
to a single point charge. This function is called the impulse response function 
(or Green’s function), and it is the response at (r,0) to a single source at (p,<b)- 
The difficulty in finding, this function is due to the fact that it must vanish on 
the boundary. If we didn’t require zero, then the problem would be easy, since 
we already know that 


is the potential due to a charge at (p,<b) [where r is the distance from the charge 
(p.<b)j. 

Physically, finding G(r, 0,p,4>) corresponds to one of the following: 

1. Finding the equilibrium temperature inside the circle with a heat source 
at (p.<b) and the boundary temperature fixed at zero. 

2. Finding the height of a stretched membrane fixed at zero on the boundary 
but pulled up to a great height at (p,d>). 

3. Finding the electrostatic potential inside the circle due to a single positive 
charge at (p,<b) with the boundary potential grounded to zero. 

We will now find Green's function; it will look something like Figure 36.3. 



FIGURE 36.3. Green's function G(/-.0,p.<b) due to a source at (»>.<b). 
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Steps for Finding The Solution 


STEP 1 Since the function 


is the potential at /* =■ (/.«) due to a single unit charge at Q = (p.d>) (where 
R is the distance from P to Q). the only thing left to do is modify the function 
so that it is zero on the boundary. 

STEP 2 Physicists know from experiments that the potential field due to positive 
and negative charges placed a given distance apart give rise to circles of constant 
potential (Figure 36.4). 



FIGURE 36.4 Potential field due to two oppositely charged particles. 

So the strategy in finding Green’s function is to place another charge (negative) 
outside the circle at such a point that the potential due to both is constant on 
the circle r = 1. We can then subtract this constant value to obtain a zero 
potential on the boundary. It is obvious now that this potential will satisfy our 
desired properties for G(ri'0,p,d>). The big question is. of course, where do we 
place the negative charge outside the circle, so that the potential on the boundary 
is constant? Without going into the details, we can show rather easily that if the 
negative charge is placed at Q = (p,3>) = (l/p,<t>), then the potential 

u(/\0) = ,n UR ~ i ln 

due to the two charges will be constant on the circle r = 1. The variables R and 
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R are the distances from the two charges to (r,0). In fact, the constant potential 
on the circle r — 1 can easily be shown to be 

ln p (A positive constant) 

See Figure 36.5 



FIGURE 36.6 Charges at Q and Q giving rise to constant potential at 
r = 1. 

With these steps in mind, we construct Green’s function 

(36.3) G(r, 0,p,4>) = ;p- In 1 IR - ~ ln 1 IR + ln p 

2-it 2ir 2 tt 

/ / \ s 

Potential due to -Potential due to Subtracting the 

positive charge negative charge constant potential 

at Q — on the boundary 

where 



(These two formulas are just trigonometric formulas for the distance between 
two points in polar coordinates.) To find the solution to our original problem, 
we merely superimpose the impulse functions; this brings us to the final step. 

STEP 3 Superposition of the impulse responses. This step is easy; we just write 

u(r,6) = jf jf G(/\0,p,d>)/(p,<t>)p dp d<t> 
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NOTES 

1- ft is also possible to solve 

PDE Vhi = 0 0 < r < i 

BC w(l,0) W £(0) 0 ^ 0 ^ 2ir 

^ ““ ' he ~ >" * .he so,„o„ „ 

“ ( ' ,9) " I *)*(«# 

which, if we compute rather Iedloils rompiltation) ^ 

(36.5) u (r,B) = ~ f T. 1 - r 2 ] 

2lT ^ L 1 ~ 2r cos (6 - 4 ,) + r i JS(<t>) d<$> 

, ; S ,he Pd!SOn in " ; * rI ‘ 3 l we found in Lesson 33 

- *!' S ° lut,0n t0 the S er >eral Dirichlet problem 

POE ■ 0<r<, 

BC. m( 1,0) = ^(0) ()< e «2ir 

3 r d r ? e SUm ° f eqU3ti0nS (36 ' 4 > and 06.5). 

’ funcSon ^ ° f the 

£r and “ c " - * - 

4 - - ^ must resorl 
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PROBLEMS 




J 


1. Find the potential due to a point source in three dimensions. 

2. Find Green's function G(x, v.lj.-n) for Laplace’s equation in the upper-half 
plane y > 0. In other words, find the potential in the upper-half plane at 
the point (x,y) (zerb on the boundary y = 0) due to a point charge at (e.-n). 
See the following figure. 



HINT If we place a negative charge at Q = ((.-n), then it’s clear_that the 
potential field on the line y = 0 due to the two charges at Q and Q is zero. 
Hence, Green's function would be the resultant field due to these two charges. 

3. Using the results of problem 2, what is the solution to Poisson's equation 

= -k in the upper-half plane with zero BC? 

4. How would you go about constructing Green’s function for the first quadrant 
.r > 0. y > 6? 

5. An alternative approach to solving Poisson's equation that works sometimes 
is the following; suppose you want to solve: 

PDE V-u =1 0 < r < l 

BC *i(1.0) = sin 0 t) s 0 s 2- 

Start by trying to find any particular solution of ^7 : tr = I by substituting 
«,(r,0) = ,4r 

into the differential equation and solving for the constant, 

After finding a particular solution ».,(/•, tt). consider letting u m tv - it., 
and ask the question, what boundary-value problem will ti'ir.it) satisfy? 
After you determine this, solve for »e(r,t>). Finally, what is the answer ti(r.U) 
of the oritiinal problem? Does it check? Look at the answer carefully ; what 
is the interpretation of each term? 
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OTHER READING 


I Introduction to Partial Differential Equations with Applications by E. C. Zachmanoglou and 
D. W. Tboc. Williams and Wilkins. 1976: Dover. 1986. More advanced than this book, but well- 
written with several examples: could be used for extra reading by serious students. 

2. Partial Differential Equations of Mathematical Physics by Tvn Mvint-U. Elsevier. 
1973. A good discussion of Green's function. 


Numerical 
Approximate 
Methods 


PART 5 

and \ 
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LESSON 37 

Numerical Solutions (Elliptic 
Problems) 


PURPOSE OF LESSON: To show how a partial differential equation 
can be changed to a system of algebraic equations by replacing the partial 
derivatives in the differential equation with then finite-difference approx- 
imations. The system of algebraic equations can then be solved numerically 
bv an iterative process in order to obtain an approximate solution to the 
PDE. 

It is also pointed out that the reader can obtain an existing computer 
package (ELLPACK) that will solve general elliptic problems. 


So far, we have studied several techniques for solving linear PDEs. However, 
most of the equations we’ve attacked were reasonably simple, had reasonably 
simple BCs, and had reasonably shaped domains. But many problems cannot 
be simplified to fit this general mold and must be solved by numerical approx- 
imations. Over the past fen years, scientists and engineers have begun to attack 
many more problems as a result of more computing power and more sophisti- 
cated numerical methods. Several new techniques have been developed to take 
advantage of high-speed computing machinery. Nonlinear problems in fluid 
dynamics, elasticity, and potential theory involving two and three dimensions 

are being solved today that were not even considered ten years ago. - 

There are.several procedures that come under the name of numerical methods. 
The reader can look in reference 1 of the recommended reading for a more 
complete discussion of these techniques. This lesson and the next two show how 
the very popular finite-difference method can be used to solve elliptic, hyperbolic, 
and parabolic equations. 

To begin, we introduce the idea of finite differences. We then show how to 
use these finite differences to solve a Dirichlet problem inside a square. 

Finite-Difference Approximations 

First, we recall the Taylor series expansion of a function f(x) 
f{x f /,) = /(.v) - n.v)/i - ~ h- 
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(37.3) f'(x) s i- [f{x + h) - f{x - /»)] . . . 

By retaining another term in the Taylor series, this type of analysis can be 
extended to arrive at the central-difference approximation of the second deriv- 
ative f "(x) 

(37.4) fix) * p [fix + h) - 2/(x ) + /(a: - h )] 

We now extend the finite-difference approximations to partial derivatives. If 
we begin with the Taylor series expansion in two variables 

h~ 

m(a- + h,y) = u(x,y) + u x (x,y)h + u xx ix,y)— + . . . 

h 1 

u(x - h,y) = w(a-,.v) - u x {x,y)h + u xx (x,y)— 
we can deduce the following: 

u x {x,y) = U ^ X ft '~ U ^ X '^ - (Forward difference) 
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FIGURE 37.1 Grid lines for the Dirichlet problem inside a square. 

It is also convenient (especially if we want to use a computer) to use the following 
notation: 


u(x.y) = u u 

m(a, V + it) = , , 
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u(x.y - k) = 
u(x + h,y) = 
u(x - /i.y) = m„_, 

“*(x,y) = ^ («,./„ ~ 

« y (^.y) = ^ 

' j (Central-difference formulas) 

“«( *’y) = ^ (««-. - 2 m ,., + 
u : .,,(x,y) = ^ ~ 2 m ,., + 

Our strategy for solving this Dirichlet problem is to replace the partial derivatives 
in Laplace's equation 

U xx + Uyy = 0 

by their finite-difference approximations. Doing this and using the compact 
notation m„, we have the following difference equation: 

V2 “ = £ (“w i ~ 2u >,i + + ji («/+,., ~ 2m,, + m,.,.,) - 0 

By letting the two discretization sizes h and k be the same, Laplace’s equation 
is replaced by 

(37.6) (m + m,._ ,, + h,,„ , + m„_| — 4m, ,) = 0 

or solving. for. 

1 

% = 4 + Mi.,., + M„_‘, ) 

Note that here the m , ,'s would stand for the solution at the interior grid points. 
This last equation says that we can approximate the solution m,- by averaging 
the solution at the four neighboring grid points. Hence, we can devise a numerical 
strategy for solving the problem. 

Numerical Algorithm for Solving the Dirichlet Problem 
(Liebmann's method) 

STEP 1 Seek the solution , at the interior grid points by setting them equal 
to the average of all the BCs (reasonable start). 
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STEP 2 Systematically run over all the interior grid points, replacing the old 
estimates by the average of its four neighbors. It doesn't make much difference 
in what order this process is carried out, but. generally, it is done in a row by 
row (or column by column) manner. After a few iterations, this process will 
converge to an approximate solution of the problem. The rate of change of this 
process is generally slow but can be speeded up in a number of ways: interested 
readers should consult reference T of the recommended reading. 

This completes the discussion of our Dirichlet problem: the reader is asked 
to carry out three iterations of Liebmann’s method in the problems. 

NOTES 

1. If we write equations (37.6) for four interior grid points (that is. m = n 
= 4), we will get the four algebraic equations: 

-4m 22 + 0 + sin (tt/ 3) + t< 23 + u 32 = 0 
(37.7) - 4m 23 + it 22 + sin (2 it/3) + 0 + u n = 0 

— 4m 32 + 0 + m 22 + u 33 + 0 — 0 

— 4m 33 + u 32 + m 23 + 0 + 0 = 0 

from which we can solve for m 22 , m 23i u 32 , and « 33 . The solution of these 
equations can be found by iterative methods, and Liebmann’s method is one 
of them. 

2. If we made our discretization sizes h and k smaller (so that we had more 
grid points), the analysis would be similar except that the system of algebraic- 
equations (37.7) would be larger. In general, the number of equations will 
be equal to the number of interior grid points. 

3. The system of equations (37.7) can be written in matrix form 


-4 ' 1 ’ 1 0 


IU 2 


-sin (tt/3) 


-0.86 

r -4 o i 


U 2} 


-sin (2tt/3) 


-0.86 

1 0-4 1 


« 3 j 


0 


0 

0 1 1 — 4j 


_Uyy_ 


0 


0 . 


In general, when we have several equations (maybe 1,000) this coefficient 
matrix takes on a specific form with many zeros. The solution of these sparse 
systems of equations can be found by special numerical methods. Iterative 
procedures, such as Jacobi's method. Gauss Seidel, and successive over- 
relaxation (SOR) are commonly used (along with techniques for speeding 
up convergence). 

4. To solve the Neumann problem where there are derivatives on the boundary, 
we must also replace these derivatives by some finite difference approxi- 
mation. 
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5. We can also solve equations like: 

(a) u„ + it,., = fix.v) (Nonnomogeneous equations) 

(b) xu„ -r u,., + 2 u = sin (.v - v) (Variable coefficients; non- 

homogeneous) 

(c) sir. xu„ + u„ + 2>tt = 0 (Variable coefficients) 
by the finite-difference method. 

(\ If the domain of the problem is an irregularly shaped region, we can overlay 
the region with grid iines and then approximate the solution at nearby grid 
points by interpolating the boundary conditions. After doing this, we can 
proceed in the usual manner. See Figure 37.2. 



□ = New BC found by 


FIGURE 37.2 


7. Several journals list computer programs for solving PDEs; some of them 
are: 

(a) ACM Transactions on Mathematical Software 

(b) Computer Journal 

(c) Numerische Mathematik 

(d) BIT 

In addition, an extensive package of programs, called ELLPACK, has recently 
been designed for the purpose of solving fairly general elliptic boundary-value 
problems. This package will solve a wide variety of problems in two or three 
dimensions, various coordinate systems, arbitrary boundaries, general BCs, by 
an assortment of different methods.* 

* Anvone interested in obtaining information about this program should contact Dr. 
John Rice. ELLPACK User s Guide CSD-TR 226, Computer Center, Purdue University. 
West Lafayette, Indiana 47907. 
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PROBLEMS 


1. Derive approximation equation (37.4) for the second derivative fix) 

fix) = p[/(.v + h) - 2 .fix) + f(x- h ) ] 

2. Carry out the compulation for two iterations in Dirichlet problem (37.5) 
using the Liebmann iterative process. Is the method converging? 

3. What algebraic equations must be solved when you use finite-difference 
approximations to solve the following Poisson equation inside the square: 

PDE u„ + u,,. = f(x,y) 0 < x < 1 0 < y < 1 

BC u(x,y) = g(x,y) On the boundary 

4. What algebraic equations must you solve when replacing the derivatives in 

PDE u„ + + 2u = 0 0 < jc < 1 0 < v < 1 

BC u(x,y) = g(x,y) On the boundary 

by their finite differences? 

5. How would you solve the Neumann problem inside the square 

PDE + Uyy = 0 0 < x < 1 0 < y < 1 . 

fu = 0 On the top, bottomland 

BC J , left-hand side of the square 

' (1, } -) =1 0 * y * 1 

by the finite-difference method? 

6. WTite a flow diagram to solve the Dirichlet problem inside the square 

PDE + u } ,. = f(x,y) 0 <x <1 0 < y < 1 

BC u(x,y) = g(x,y) On the boundary 

with an arbitrary number of grid lines. If you know a computer language, 
write a program to carry out these computations. 

OTHER READING 

1. Numerical Methods for Partial Differential Equations by W. F. Ames. Academic 
Press, 1977. An up-to-date authoritative text on numerical techniques. 
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2. Numerical Analysis by S. S. Kunz. McGraw-Hill, 1964. Chapter 13 offers a clear, 
precise summary of some numerical methods in PDE theory. 

3. Numerical Solution of Partial Differential Equations by G. D. Smith. Oxford Uni- 
versity Press. t965. A concise book describing finite difference methods in PDE theory 

cta,l,wn " e " An Explicit Finite-Difference 

Method 


LESSON 38 


PURPOSE OF LESSON: To introduce the idea of explicit finite-dif- 
ference methods and show how they can be used to solve hyperbolic and 
parabolic problems. The basic idea is that after a PDE like 

it, = u xx 

is replaced by its finite-difference approximation, we can solve for the 
solution explicitly at one value of time in terms of the solution at earlier 
values of time. In this way, an initial-boundary-value problem (hyperbolic 
or parabolic) can be solved by consecutively finding the solution at larger 
and larger values of time. 

A problem we face is that as we make the grid sizes small so that the 
finite differencesaccurately represent the derivatives, the number of com- 
putations increases, and so the roundoff error increases. 


In the previous lesson, we solved elliptic boundary-value problems (steady-state 
problems) where the PDE was satisfied in a given region of space, and the 
solution (or its derivative) was specified on the boundary. In those types of 
problems, we found the approximate solution at the interior grid points by solving 
a system of algebraic equations. In other words, the solution at all the interior 
grid points was found simultaneously. 

In this lesson, we will show how time-dependent problems can be solved bv 
finite-difference approximations. The idea here is that if we are given the solution 
when time is zero, we can then find the solution for t = A t, 2Ar, 3A t, ... by 
means of a marching process. Replacing both the space and time derivatives by 
their finite-difference approximations, we can then solve for the solution fc in 
the difference equation explicitly in terms of the solution at earlier values of 
time. This process is called an explicit-type marching process, since we find the 
solution at a single value of time in terms of the solution at earlier values of 
time. 

To show how this method works, we consider a representative problem from 
heat (low. 
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The Explicit Method tor Parabolic Equations 


Consider the problem of heat flow along a rod initially at temperature zero, 
where the left end of the rod is fixed at temperature one. and the right-hand 
side experiences a heat loss (or gain) proportional to the difference between the 
temperature at that end and an outside temperature that is given by g(r). In 
other words, we solve the problem 

PDE u, = 0 < a- < 1 0 < / < oc 

BCs {S!!)'='-i»(i,o- S (o) 0<,< * 

1C m(a.O) = 0 0 »£ x « 1 

To solve this problem by finite differences, we start by drawing the usual- rec- 
tangular grid system with grid points: 

x. = jh j = 0, 1 , 2 n 

l = ik i = 0 , 1 , 2 m 

See Figure 38.1. 



FIGURE 38.1 Grid system for a heat-flow problem. 

Note that in Figure 38.1. the u u on the left and bottom are given BCs and ICs, 
and our job is to find the other u,J s. To do this, we begin by replacing the partial 
derivatives it, and it,, in the heat equation with their approximations 

u, = ^ [m(.v./ + k) - xr(A.r)] = ^ - it,,) 
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u xx - j-; [«(* -r h.t) - 2u{x,t) + u(x - h.t)] - — (u, ,. , 2u, , 

By substituting these expressions into u, = t/„ and solving for the solution at 
the largest value of time, we have 


This is the formula we are looking for, since it gives us the solution at one value 
of time in terms of the solution at earlier values of time (note that, the index i 
stands for time); Figure 38.1 shows those values of the solution that are involved 
in the formula. 

We are now almost ready to begin the computations. First, however, we must 
approximate the derivative in the right-hand BC ' 

« x (l,0 = ~ [«( 1,0 - g(0] 


' where g, = g(ik) is given. Note that we have -replaced w,(l,r) by the backward ■ 
difference approximation, since the forward-difference approximation would re- 
quire knowing values of u, tf outside the domain. Solving now for u, -n in this BC 
gives us 


With this equation and our explicit formula (38.2), we are ready to begin the 
computations. 


Algorithm for the Explicit Method 

STEP 1 Find the solution at the grid points for t = At by using the explicit 
formula 
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See Figure 38.2. 



FIGURE 38.2 Diagram illustrating the explicit method. 
STEP 2 Find „ from formula (38.4) 



Steps 1 and 2 find the solution for t = dr. To find the solution for r = 2d t 
(second row from the bottom in Figure 38.2), repeat steps 1 and 2, moving up 
one more row (increase i by 1) and using the values of « f/ just computed; for 
t = 3dr, 4dr, . . . , keep repeating the same process. 

In order for the reader to be able to computerize this method, we will present 
a fairly detailed flow diagram of the method in Figure 38.3. Those students not 
familiar with flow diagrams should think of them as links between computational 
algorithms and detailed computer programs. Flow diagrams explain in a precise 
manner how the computations should be carried out. 

NOTES 

1. There is a serious deficiency in the explicit method, for if the step size in 
t is large compared to the step size in x, then machine roundoff error can 
grow until it ruins the accuracy of the solution. The relative size of these 
two numbers ,v and / depends on the particular equation and the BCs. but. 
generally, the step size in t should be much smaller than the step size in ,v. 
In reference 3 of the recommended reading in Lesson 37, the author proves 
that we must have kllf 0.5 in order for this method to work. 

2. A general rule of thumb is that as the step sizes St and 2 lv are made smaller 
the truncation error of approximating partial derivatives bv finite differences 
decreases. However, the smaller these grid sizes, the more computations 
necessary, and, hence, the roundoff error, as a result of rounding off our 
computations, will increase. Therefore, we have the phenomenon illustrated 
in Figure 38.5. 
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FIGURE 38.3 . Flow diagram of the explicit method. 


3. The hyperbolic problem 

PDE u„ = u, x l)<x < 


BCs 

ICs 


Mi.o.r) = giir, 

tr(l.r) = g : (r) 

rr(.v.U) = tb(.r) 
h,(.v.O) = Mx) 


0 


0 < t < * 
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FIGURE 38.4 Arrays used in the explicit method. 


FIGURE 38.5 Total error as a function of grid size. 

can also be solved by the explicit finite-difference method. Here, we can 
approximate the derivatives u„ and u xx by 

u„ a — [«(*./ + k) - 2u(x,t) ~ u(x,t - A:)) 

u xx = [u{x + h.t) - 2 u(x,t) + u(x - h,i )] 

and the derivative u,(a.O) in the 1G by 

“.(*•0) s | [w(a,/c) - u(a,0)] = (m(a.A) - 6(a)] . 
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Hence, solving for u(x. i + k) explicitly in term- 
values of time eives 


u(x.t + k) = 2«(.v.r) - u(x.i 


4 + h,t ^ ~ + u(x ~ ; *. 0 ] 

From this equation, it is clear that we must already know the solutioi 
two previous time steps, and, hence, we must use the initial-velocity c 
dition 


- (u(,v.A) - d>(A-)] = 0 /(a) 


to get us started. Solving for u{x,k) gives u(x.k) = 6(a) + A6(a), and, thus, 
we can find the solution for r = A r. The solution at all later values of time 
can now' be found by our explicit formula (38.5). 


1. Find the finite-difference solution of the heat-conduction problem 
PDE u, = u xx 0 < a < 1 0 </<■*■. ■ 


IC «(a,0) = sin (tta) 0 =s a 1 

for r = 0.005. 0.010, 0.015 by the explicit method. Let h = Aa = 0.1. Plot 
the solution at a = 0, 0.1, 0.2, 0.3 0.9. 1 for r = 0.015. 

2. Solve problem 1 analytically (separation of variables) and evaluate the an- 
alytical solution at the grid points: a = 0. 0.1. 0.2. .... 0.9. 1 for r = 0.015. 
Compare these results to your numerical solution in problem 1. (You may 
wish to write a small computer program or use a calculator to evaluate the 
separation-of-variables solution.) 

3. Write a flow' diagram to carry out the computations of the hyperbolic prob- 
lem discussed in note 3 of this lesson. 

4. Do problem 1 except now replace the BC at a = 1 by 

«,0.0 = - Ml,/) - 1] 
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OTHER READING 

Finite- Difference Methods for PDF, 
& Sons. 196(1. An excellent text' wit 
problems, oil-flow problems. ;ind ; 
problems discussed. 


v by G. F. Forsythe and W. R. Wasow. John Wilev 
h several physical examples illustrated, soil-drainage 
i meteorological-forecast problem are a few of the 


LESSON 39 


An Implicit Finite-Difference 
Method (Crank-Nicolson Method) 


PURPOSE OF LESSON: To show how time-dependent problems can 
be solved by another finite-difference scheme known as implicit methods. 
In this method, we again replace the partial derivatives in the problem by 
their finite-difference approximations, but unlike explicit methods (where 
we solved for it,. explicitly in terms of earlier values), in implicit methods, 
we solve a system of equations in order to find the solution at the largest 
value of time. In other words, for each new value of time we solve a system 
of algebraic equations to find all the values. 

Implicit methods have an advantage over explicit ones, since the step 
size can be made larger without worrying about excessive buildup of round- 
off error. 

A popular implicit method known as the Crank-Nicholson method will 
be used to solve a parabolic problem. 


The difficulty with the explicit methods that we discussed in the last lesson is 
that the step size in time must be small in order for the method to work properly . 
In particular, if we were to solve the simple heat-flow problem 

PDE u, = ii„ 0 < x < 1 "()</<* 


(39.1) 


BC 


f«(0,/) = .?,(/) 

| «( 1,0 = g,(t) 


IC M(X.O) = fix) 0 « Jf * l 

by the explicit method, it would be necessary for the grid sizes A t and Ax to 



Ai 

(Axi- 


lla 
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in order for the method to be numerically stable (the roundoff errors don't build 
up). See reference 1 (p. 45 ) of the recommended reading for details of numerical 
stability. In other words, if the grid size A.r in the .indirection were chosen to 
be Ax = 0.1. then the time increment A / must be At =£ (I.5A.V- = (1.005 (hence, 
to go from 1 = 0 to i = I would lake 200 steps). 

There are. however, procedures (implicit methods) that allow us to take larger 
steps b\ doing more work per step: in these methods, we can take relatively 
large steps by solving a system of algebraic equations at each step. To illustrate 
how these methods work, we solve the following heat-flow problem. 


The Heat-Flow Problem Solved by an Implicit Method 

Consider the following problem: . 

PDE u, = u„ 0 < x < 1 0 < t < x 


IC u(x.O) = 1 0 s x 1 



FIGURE 39.1 Grid system for implicit scheme (Ax = 0.2). 
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We replace the partial derivatives u, and by the folio 1 


h,,(x./I = — [u(x + h.t + k) - 2 id.v.r -f k) + u(x - li.t - A)[ 

+ — V U' + h'l) “ 2u(x,t) + u(x - h,t)\ 

where A is a chosen number in the interval [0.1]. Note that our approximation 
for is a weighted average of the central-difference approximation to the 
derivative at time values t and t + k. In the special case when A = 0.5, it 
is just the ordinary average of these two central differences, while if A = 0,75, 
our approximation puts weights of 0.75 and 0.25 on each of the two terms (note, 
if A = 0, it is. the usual explicit finite-difference method we used in the last 
lesson). 

If we now substitute the approximations for u, and u xx into our problem, we 
get the new finite-difference problem 


ff§te( 39 - 3 ) 


Now. if we rewrite the difference equation in (39.3), putting the u, s with, the 
largest time subscript ((-subscript) on the left-hand side of the equation, we 
arrive at the equation 

(39.4) -Aru |i|;i , + (1 + 2rA)n,* 1( - ArM (il / _, 

= r(l - A)u, , + [1 - 2r( 1 - A)]u w + r(l - A)u, v _, 

where we have set r = klh 2 for convenience. Note that for a fixed subscript i 
and for j going from 2 to n - 1. this is a system of n - 2 equations in the n - 2 
unknowns u u ix , 4 . . . . [which are the interior crid points 

at t = (/ + 1 )A/]. 
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To help show exactly what s are involved in this formula, we write it in 
the symbolic or molecular form shown in Figure 39.2. 



FIGURE 39.2 The molecular form of the implicit formula. 

We now show how equation (39.4) can be used to find the solution of problem 


Implicit Algorithm for Heat Problem (39.2) 

1 . Pick some, value for X (0 « \ « 1). Note that if X = 0. then equation 
(39.4) is the same as the explicit formula sve developed in lesson 38. 

STEP 2 . Pick h = A * = 02 and * = Af - 0.08 (r = k/h 2 = 2). This gives six 

grid points in the ,r-direction (four interior grid points); see Figure 39.1. Also 
let’s pick the weight parameter X = 0.5 (which is called the Crank.Nicolson 
method). If we now apply our computational molecule to the first and second 
rows (i = 1), moving it from left to right (/ - 2. 3, 4, 5), we get the following 
four equations: 

— t<2l + 3« 23 — = M,| — U n + M|3 = 1 

Which if written in matrix form, placing the four unknown interior grid points 

u 22 t w 23> l hi' and m 3 j on the left-hand side of the equation, gives 
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This system of equations is called a tridiagonal system, and to solve it, we use 
a method that transforms a tridiagonal' system of the form 



There is nothing magical about this transformation; it just involves rewriting the 
original systehi of equations in an equivalent form. The point is, once we have 
written the system of equations in the new form, it is easy to solve. Solving from 
bottom to top, we have 

Applying this method to our system of four equations (39.5). sve get: 

t/ ;; = 0.60 
= 0.80 
u u = 0.80 
ti s = 0.60 
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This gives us the solution (approximation) at the interior grid points for t = At. 
After finding these values, we move to the next time value and solve a new set 
of equations. 

This implicit method takes more work at each value of time than does the 
explicit method, but it enables us to pick a larger At and still get a good ap- 
proximation. 


PROBLEMS 


1. Derive equation (39.4) from the difference equation in (39.3). 

2. Tell how you svouid solve the problem 

PDE u, = u xx 0 < x < 1 


BCs 


u(O.r) = 1 

.“*0.0 + u(l.t) = g(t) 


0<t<oc 


1C u(x,0) = 0 0 « * « 1 


by the implicit finite-difference method. 
3. How would you solve 



by the implicit method? 

4. What is the molecular form of equation (39.4) when we pick X = 1? 

5. Write a flow diagram to solve heat-flow problem (39.2). Write a computer 
program if facilities are available. A good experiment would be to solve this 
problem numerically with a simple 1C u(x.O) = sin (tix) for different values 
of the parameter X. You could compare the true analytical solution, which, 
in this case, is 


u{x,t) = e~"'" sin (nx) 

with the numerical solution for different values of X. 

6. Solve the system of algebraic equations (39.5) using the formulas given it 
the lesson. 
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OTHER READING 


Numerical Methods in PDEs by W. F. Ames. Academic Press. 1977. An excellent book 
with applications to fluid dynamics and elasticity. 
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LESSON 40 

Analytic versus Numerical 
Solutions 


PURPOSE OF LESSON: To discuss the relative merits and demerits 
of analytic and numerical solutions to PDEs. The importance of mathe- 
matical models in identifying physical quantities (parameter identification) 
is presented, and an important example from biology is discussed. 


It’s probably time we had a discussion about the relative merits and demerits 
of analytic and numerical solutions. First of all, let’s make sure we know what 
we mean when we talk about these types of solutions. 

Meaning of Analytic Solutions 

Analytic solutions are those solutions where the unknown variable u is given as 
a mathematical expression in terms of the independent variables and parameters 
of the system which are generally infinite series or integrals. 


Meaning of Numerical Solutions 

Numerical solutions, on the other hand, refer to finding the solution of PDEs 
by replacing the differential equation with an approximate equation and solving 
the easier one. For example, the method of finite-difference approximations 
replaces partial derivatives with finite differences, so we approximate the solution 
to a PDE by solving a tinite-dilterence equation. The result is aeneraliv a mbl-' 
ot numbers listing the solution u for various values of the independent variables' 
Now that we know the basic meaning of the two tvpes of solutions let's ask 
which is better. 
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Comparing Numerical and Analytic Solutions 

Suppose we have the simple parabolic IB VP 





FIGURE 40.1 Solution of heat equation (40.1) for various values of time. 
The question here is, would we rather be given the analytic solution 



TABLE 40.1 ‘ 

0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1. 


0 

1 

111 11 

1111 111 

0.01 

0 

0.2 0.34 

• 0.34 0.2 ■ 0 

0.02 

0 

0.15 

0.15 0 ! 

0,Q3 

0 


o 1 
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This is ;i good question; the answer depends on what we want to do with the 
solution. There are. however, some clear cut advantages to each of the two 
types of solutions: first the advantages. 


Advantages of the Analytic Solution 

1. Equation 140.2) obviously contains more information than a table of 
numbers. If we wanted to evaluate the solution at any specific point (x.f). 
we could do so with any degree of accuracy merely by adding a sufficient 
number of terms in the infinite series. An upper bound on the error could 
be found without much difficulty. 

2. The analytic solution allows us to find the solution at a single point (x,t) 
without going through the entire marching process of finding the solution 
at all other points, as we did in the explicit and implicit methods. 

3. The analytic solution allows us to find the solution at any point and not 

just the grid points. 

4. Probably most important of all. the analytic solution tells us how physical 
parameters, initial and boundary conditions affect the solution. 

Numerical solutions do not bring out these interrelationships, since we are 
finding the numeric solution for specific parameters, initial and boundary con- 
ditions. In many situations, it is critical to know the relationship between the 
parameters of the model and the solution, since our goal may be to estimate the 
parameters from the solution. For example, suppose we measure the solution u 
experimentally, and we know the analytic solution 


then we can more or less solve for the parameters as a function of the data v 


parameters = function of u = function of the data 


This concept is called parameter identification, and it is one of the major 
reasons for solving PDEs. Later on in this lesson, we give an important example 
of parameter identification in biology. First, however, let's see why numerical 
solutions are worthwhile. 


Advantages of Numerical Solutions 

There is one major advantage to numerical solutions, and it is that many prob- 
lems do not have known analytic solutions. Practically all nonlinear PDEs must 
be solved by numerical methods, and. in fact, most realistic models in physics, 
chemistry, biology, and so forth, are nonlinear in nature. The linear models 
represent, for the most part, approximations where we have thrown out certain 
nonlinear components. Some very important nonlinear equations such as: 
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I 


1. Nonlinear wave equation u„ = it,. + f(u) 

2. Reaction-diffusion equation u, = u„ + f(u) 

3. Hodgkin-Huxley equations 

do not have known analytic solutions for all nonlincarities / and g. Hence, the 
general attack for most nonlinear problems (and some linear ones) involves the 
use of numerical solutions. 

We now consider an example of how analytic solutions can be used to find 
important physical parameters. More details of this problem can be found in 
the recommended reading. 


Parameter Identification (in Biology) 

Suppose a biologist is trying to determine how fast potassium ions (K*) diffuse 
in an exoplasm solution. By knowing the diffusion coefficient, we can tell a lot 
about how nerve impulses are transmitted along axons. The problem is that this 
coefficient is practically impossible to measure directly. What we' can do, how- 
ever, is find a mathematical relationship between the potassium concentration 
u(x,t) and the diffusion coefficient D, so that by measuring u(x,t). we can find 
D. The following example shows how this works. 

Biologists Hodgkin and Keyes found that after isolating giant squid axons in 
a special salt solution, the concentration of radioactive potassium ( J2 K) along 
the axons could initially be approximated by the curve 

u(x,0) = Ae- lV ° 

In other words, the parameters A and a in the curve were found so that the 
equation fit the observed data points (least-squares fit). See Figure 40.2. 



FIGURE 40.2 Initial concentration of * 2 K. 

It was also determined that after this initial concentration, the concentration in 
a normal environment flowed down the axon both by convection and diffusion. 
Hence, Hodgkin and Keyes assumed the concentration u could be described by 
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the convection-diffusion IVP 


(40.3) PDE u, = Du x , -Vu x x < » 

IC u(x, 0) = -*> <x < x 

" aS so ! ved in Lesson 15 b » transforming into moving coordinates 

V „d er ,; em '” ,be ;?; ,he idea 0f ">»vi„g coordinates was o ”l| 

v and solve the pure diffusion problem to get S 

“ {XJ) 

AVa | ^ ^ ^ 


th , e S0luti0n '° ' he problem with ^ = 0). Substituting .r - Vt for t 
gives the solution to problem (40.3); namely, 5 * 


!' '“™' d “* **! Hod S k '" ™ d Keyas were able to measure tr directly, so that 
SeEnt' D M ? and"v ' “ onsl y, be,WM " “ K concentration and the diffusion 
SevmeasuSil d kddwn) ' Bk ^signing an experiment where 

the y a r r V he potassium concentration u(x,t) at som e fixed point x 0 along 
rn.ntT u dlfferen . t values of time - the y wef e able to find the value of D that 
made the theoretical curve (40.4) fit the data (Figure 40 3) 



FIGURE 40.3 Fitting the curve u(V) to the observed data points. 

differed Va "° US Values of the diffusi °" coefficient D. we set 

to [he PDF rh" ' r0,/ ’ Ce ', W , e Pick the value of D that calces the solution 
E fit the experimental data. In their experiment. Hodgkin and Keyes 
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found that the diffusion coefficient of K + in exoplasm was D = 1.5 x 10 ~ 5 
cm 2 /sec. 


PROBLEMS 

1. How could you construct an experiment to estimate the parameter a in 
problem (40.1) using analytic solution (40.2)? 

2. Least-squares approximations minimize the sum of squares (SS) between 
the curve and the data points. For example, the least-squares line v(x) = 
a + bx that approximates data points (j:,, y,), (,r 2 ,y 2 ), . . . (x n ,y„) would be 
the specific line that minimizes (see Figure 40.4). 



FIGURE 40.4 Least-squares approximation at data points. 

SS = 2 [y, - (a + bx)] 1 

Find constants a and b in terms of the data points (x „y ( ) so that this line is 
the least-squares approximation. 

3. An important problem in biochemistry is determining the molecular weight 
of the macromolecule myoglobin. One approach is to place a certain blood 
solution into an ultracentrifuge (very fast centrifuge) and spin it for a given 
length of time. The equation that describes the concentration of the liquid 
in the centrifuge is known as Lamm’s equation: 

1 d 

u, = ~ — (Dru r - su-r-u) 0 < r < 1 

where 

r = distance from the center of the centrifuge 

D = diffusion coefficient (depends on the molecular weight of myoglobin) 
;■ = sedimentation coefficient (computed experimentally) 
o> = angular velocity of the centrifuge (known) 
u(r.t) = concentration of the medium in the centrifuge 

The approach in finding the molecular weight of myoglobin is to find the 
steady-state solution u{r,x) of Lamm s equation by lettiru; it, = !) and solving 
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the ODE for u (r,x). The question is. how do you design an experiment 
using this steady-state solution tt(r, = ) to estimate the molecular weight of 
myoglobin? 

OTHER READING 

Introduction to Mathematical Biology b> S. 1. Rubinow . John Wiley A; Sons. 1976. Several 
applications of PDEs to biology are given in this text. 
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LESSON 41 

Classification of PDEs (Parabolic 
ana' Elliptic Equations) 


PURPOSE OF LESSON: To introduce a new- coordinate svstem 
into the second-order linear equation 

+ Bu xy + Cu yy + Du, + Eu v + Fit = G 

for the cases 

B 2 - 4AC = 0 (Parabolic case) 

B 2 - 4 AC < 0 (Elliptic case) 

and in each case, show how the equation can be written in one of the two 
canonical forms 

(Parabolic canonical form) 
u tt + W n -1 = < H4.'n.«.« { .M„) (Elliptic canonical form) ' 


In Lesson 23. we classified the general second-order linear equation in two 
variables 

(41.1) Au xx + Bu xy + Cu yy + Du x + £w, + Fu = G 

as one of three basic types and, in particular, transformed the hyperbolic, equation 
into its two canonical forms. 

In this lesson, we will show how parabolic and elliptic equations can also be 
reduced to canonical form. 

Reducing Parabolic Equations to Canonical Form 

In this case, we consider equations of the form (41.1) with B 2 - 4AC = 0 and 
introduce new coordinates (£,ti). so that the equation takes the form 

U,,,, = <h(£.TJ,M.M t .W n ) 
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Introducing new coordinates £ = £(.r,y) and = ^(.r.y) into equation (41.1) 
gives us the same equation as before; namely, 

(41.2) Au n + 5m £ i) + Cu m 4- Du,. 4- Eu 4- £u = G 
where; 

A=Ag + ££,£, + C§ 

B = 2A Z'-q, + B(i,i i, + £ v t),) + 2q,v 

C_ = Ati x + 5t| x t| v + Cti; 

(41.3) D = A£,„ + Bi,, + C£ rr + D£, + ££ v 

E - + Bi)„ + Ci)„ + Dt), + £ t) v 

F_= F 

G = G 

However, our goal now is to set B and either A or C equal to zero and solve 
for £ and q (we can see in a moment that_£ a - 4AC must be zero in order to 
carry out this plan). Here^we’ll set A and B equal to zero and solve the resulting 
equations. First, setting A = 0 and solving for [£,/£,.] we have 

[fc/y = -5/2 A 

Hence, we can find the coordinate £ = £(* ,y) that satisfies this equation by 
setting } 

% = ~ [&/$,] - BI2A 

and finding the implicit solution 

- e(-v.v) .= c.. . 

to this equation. 

For example,. if £ = B/2A = 3, then we have y - 3* = c, and, hence, £(*.>>) 

= y - 3x satisfies £A- = -3 (and. thus, makes A = 0). 

_ So, we are half done; we have found one coordinate £ = f&r.y) that makes 
A - 0. The last part of the problem is to find ^(x.y) so that B = 0. 

Here’s where we get a break. It turns_out (since B 2 - 4AC = 0) that bv 
picking £ so that A = 0. the coefficient B is automatically zero. In fact we'll 
verify this right now. The coefficient B is given by 

B = 2A£,t 1> + £(t,q v + £ v t),) + 2C£ y q v 
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and since B 2 - 4AC = 0, we can write 

5 = 2 (VA£, + VC£ v ) (V An, + V'Cr,,) 
and since £A = - BI2A = - 2 VAC/2A = - VGA, we have 
5 = 2 VA j^VAn, 4- VCt),J 

which, of course, is zero because A iszero. 

So, by our choice of £, both A and B are zero. and. hence, we can pick n anv 
way we like (as long as it’s never parallel to the £ coordinate). Thus, we can 
pick something simple like r\ = y. 

All that remains is to find the new canonical equation, and to get this_, we 
merely substitute £ and into equations (41.3) to find the coefficients A, B, C. 
D, £, F, and G. This finishes the parabolic case; before going onto another 
topic, we present a simple example. 

Transforming the Parabolic Equation u xx + 2 u + u = 

0 into Canonical Form 

We begin with the simple equation 

u xx + 2 u xy 4- u„ = 0 

t where A = 1, B = 2, C = 1, D = £ = £ = G = 0. Hence, B 2 - 4AC = 0 

»' for all x and y. To find the new coordinates £ and -ri and the canonical equation, 

we proceed as follows: 

STEP 1 Write the characteristic equation (only one now) 

£ - - KAJ = 5/2.4 = 1 
Solving for v (integrating) gives 


and, hence, £ = y - x will satisfy the characteristic equation and thus make A 

= 0 . 

The coordinate can be chosen in any was. as long as it isn't parallel to the 
£ coordinate; hence we choose 

4 = y 
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The new coordinates 

(41.4) C-.v- x 

f] = y 

are shown in Figure 41.1. 


FIGURE 41.1 New coordinate system 4 = y - x, ty = y. 


STEP 2 The last step is to find_th£ new canonical equation. Substituting £ and 
t) into the new coefficients A, B, C, D, E, F, and G gives: 

A = 0 (Must be true; we set it equal to' zero and ’solved for 4) 

5 = 0 (We have already shown that this is zero) 

C = Ar\] -r S-rijT), + Or); = 1 
(41.5) D = Ai xx + + C$ V) + Z>4, + £4,. = 0 

£ = Ar\ xx + 5r)„ + Ct|„ + Dt\ x + £f) v = 0 

£ = F = 0 
G = G = 0 

Hence, our new equation 

Au u -i - Bu 4l) + + Du ( + £w„ + Fu = G 

is simply 

«„ = 0 



This completes the example. Before going on. let's look for a moment at this 
canonical form. This equation is so simple that we can find its general solution 
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(all its solutions). Starting with u „„ = 0 and integrating once with respect 
to T| gives 

= M) 

where /(f) is an arbitrary function of t. Integrating again gives the general 
solution w ' 

“(C.tl) = n/(£) + g(4) 

where g(4) is another arbitrary function of £. (The reader can easilv verify that 
any function of this form is a solution of «„„ = 0.) 

Now the final step. Substituting the terms of our original coordinates .v 
and v gives the general solution of 

U, x 4 - 2 U xy + Uyy = 0 

namely, 

= yf(y - x) + g (y - x ) 

For example, if we pick/(x) = sin a: and g(x) = x 1 at random, then 
“(x,y) - y sin 0’ - x) + O' - x) 2 

should be one of the infinitely many solutions of the equation. (of course, which 
solution actually models the physical problem depends on the initial and bound- 
ary conditions). 

Reducing Elliptic Equations to Canonical Form 

We start again with the general equation 

Au xx + Bu x> . + Cm,, + Du x + £m, + Fu = G 

but now fl- - 4 AC < 0. Our goal is to transform this equation into the new 
form 

U u + = Hi,i).u.u t .uJ 

by changing the independent variables. Proceeding as we did in the two earlier 
cases, we are tempted to set /l = C and B = 0 in the transformed equation 

Au h + Bu + Cm„„ + Du t + £u„ + Fu = G 
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and solve for £, and tj. Unfortunately, these equations (A - C = 0, B = 0) do 
not allow us to solve for § and as the earlier ones did, and for that reason, we 
proceed a little differently. 

We find our transformation £ = l{x.y), = t,(.r,y) as a composition of two 

transformations: we start with the first. 


Transformation 1 

We first make a transformation to new coordinates ? and -q that will make our 
equation look like 

« t „ = ,u.u { ,u„) 

It is possible to do this, but we must resort to complex coordinates. To find these 
complex coordinates ? and t), we merely proceed as we did in the hyperbolic 
case by solving the characteristic equations 



(Remember B 2 - AAC < 0) 

dy B + -4 AC 

dx 2A 

to get 

Z{x,y) = constant 
n(.t,y) = constant 
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Transformation 2 

We now make a second transformation from (^,r|) to (a, (3) via 

« = g + 3 



and the result of this second transformation changes the first equation 

«*, = MZ.WL.ttJ 

to the final form 

+ “w ~ d)(a,p, 

where <|> and il> are the general names for the right hands. 

Instead of showing that these two transformations (back to back) actuallv carry 
out the above result, let's apply these principles to a simple example. 

Changing the Equation y 2 ^ + x 2 u = 0 to Canonical 
Form 

Consider transforming the equation 

y 2 n„ + x 2 u vy = 0 

where A = y : , B - 0, C = x 2 , D = E = F = G = 0. The discriminant B 2 
- 4/4C is equal to -4 x 2 y 2 , and, hence, we will transform this equation to 
canonical form in the first quadrant x > 0. y > 0. 

STEP 1 (First transformation) 

We start by writing the two characteristic equations 

dy B - VT? 1 4 AC \ -4.vV 

dx ~ :,t “ " 2;.- " " ™ a 

dy B + \/B- - 4.4 C \ - 4.v : v- 
d . r _ ' 2.4 _ 2p ~ ' A ' ' 
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Solving these equations I 


and. hence. 


rparating variables, wc have the implicit relationship 

y : + ix : = constant 
y : - ix 2 = constant 


riU'.y) = r - ix 2 

(It doesn't really matter which function we call g and q; we could interchange 
the two if we wanted.) This transformation will reduce the original equation to 
the form 

K ( „ = 

We don't really care about this equation'(which'is a complex hyperbolic equa- 
tion). and so we continue with the second transformation. 

STEP 2 (Second transformation) 

Making the second transformation, we have 

a = = y 2 (Real part of g and q) 

(3 = = x 2 (Complex part of g and q) 

From a notational point of view, it might be best to rename the variables (a, 3) 
as (g.q) and think of our composite transformation as simply being 

t(x,y) = y : T)(x,y) = x 2 . 

STEP 3 (Finding the new equation) 

Thenew canonical form can be found by computing the coefficients A , B, C. 
D, E, F, and G in the equation 

Au tt + Bu Krt + Ctr„ T + Du i + Eu ^ + Fu = G 

from equations (41.5) w'ith g = _y : and q = x : . Doing this gives the elliptic 
canonical form 
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NOTES 


1. Second-order linear equations in three or more variables can also be classified 
except that we must use matrix analysis. For instance, the second-order 
equation in three variables 


would be classified as a parabolic equation, while the equation 



would be a hyperbolic equation. 

2. Our interest in classifying PDEs is in part due to the fact that the three basic 
types describe different kinds of physical phenomena, and we would like to 
classify mathematically these three types of physical problems. 

PROBLEMS 

1. Which of the following parabolic and elliptic equations are already in can- 
onical form: 

(a) u, = u xx - hu 

(b) u xy + + 3u = sin x 

(c) u„ +. 2 u„ = 0 

(d) =. sin jc 

2. Transform the parabolic equation + 2 + u = 2 into canonical 
form. 

3. Transform the elliptic equation u XM + 2 u yy + x 2 u„ — e~ x,/1 into canonical 
form. 


OTHER READING 

1. Second-Order Partial Differential Equations by M. M. Smirnov. Noordhoff, 1966. 
A small, well-written book; in addition to classifying second-order equations in two 
variables, he also classifies second-order equations in n variables. 

2. Methods of Mathematical Physics, vol. 2 by R. Courant, and D. Hilbert. Wilev/ 
Interscience, 1962. One of the most famous books on PDE theory written by two of the 
most outstanding mathematicians of this century; more advanced than this book, but 
contains a wealth of information for any reader willing to spend the time. 
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LESSON 42 

Monte Carlo Methods (an 
Introduction) 


PURPOSE OF LESSON: To explain the basic philosophy of Monte 
Carlo methods and suggest how they can be used to solve various problems. 
The basic idea here is that games of chance can be plaved (generally on 
a computer) whose outcomes approximate solutions to real-world prob- 
lems. A simple example would be evaluating the integral 

/ = jf x 1 dx 

by throwing darts at the unit square {(ar,y) : 0 < x < 1, 0 < y < 1}. After 
100 tosses or so, we use the fraction of darts under the curve y = x 2 to 
approximate the integral. Generating a random game (like tossing darts) 
always involves generating a sequence of random numbers, and so a pro- 
cedure for their generation is described. 


There is an interesting technique known as the Monte Carlo method (or methods) 
that can be used to solve many types of problems. Here, we present a brief 
overview of the method and then, in the next lesson, illustrate its use in PDEs 
• First of a]l Monte Carl ° methods are procedures for solving nonprobabilistic- 
type problems (problems whose outcome does not depend on chance) by prob- 
abilistic-type methods (methods whose outcome depends on chance). The general - 
philosophy of these methods is illustrated in Figure 42.1. 



FIGURE 42.1 General philosophy of Monte Carlo method. 
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Evaluating an Integral 

To illustrate this method, suppose we wanted to evaluate the integral 
/ = l fix) dx 

(a nonprobabilistic problem). To use the Monte Carlo method, we would devise 
a game of chance whose outcome was the value of the integral (or approximates 
the integral). There are, of course, many games that we could devise: the actual 
game we used would depend on the accuracy of the approximation, simplicity 
of the game, and so on. An obvious game to evaluate the inteural would be 



FIGURE 42.2 Evaluation of an integral by the Monte Carlo method. - 


It’s fairly obvious that if we randomly toss 100 or so darts at the rectangle R 
enclosing the graph, then the fraction of darts hitting below the curve times the 
area of R will estimate the value of the integral. Hence, our outcome of the 
game 

/ = [fraction of tosses under /(.v)] x (area of R) 

is used to estimate the true value of the integral /. 

To carry out the actual computation on a computer, we would have to generate 
the sequence of random points in some way (we'll discuss this shortly) and have 
the computer play the dart tossing game. Let us assume for the time being that 
we have a sequence of random points. The flow diagram in Figure 42.3 illustrates 
how the computer would attack this problem. 
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FIGURE 42.3 Flow diagram to evaluate j f(x)dx by the Monte Carlo 
method (100 tosses). 


Random Numbers 

Before going on to apply this technique to the solution of PDEs in the next 
lesson, we discuss the important topic of random numbers. In the integral just 
considered, it was necessary to generate a sequence of random points P, = (x,.y) 
that fell inside rectangle R. In other words, the A-coordinate would have to be 
a random number in the interval [«,/}]. while y, must be in [0, A-/). To find random 
numbers inside specific intervals, we start with a basic sequence of random 


numbers (uniformly distributed) inside (0.1 ). It's obvious then that if we want 
a random number x t inside [ a.h ]. we just compute 

a, = a -r (/, - a)r, 

So everything comes down to the question, how do we generate a sequence of 
random numbers / = 1. 2. . . .} uniformly distributed in [0.1], The most 
common method in use today is the residue (or congruential) method. This 
method generates a sequence of random integers (like 2120. 1401, 177. 3013, 
. . .): then, by placing a decimal to the left of these numbers, they become 
numbers between zero and one (like .212. .1401, .0177. .3013. . . .). 

So. to generate a sequence of random integers (between 0 and P. here), we 
use the residue algorithm. 

Residue Algorithm for Generating Random Numbers 

1. Pick the first random integer any way you like between 0 and P (P was 
picked in advance). 

2. Multiply this random integer by some fixed integer M (picked in advance). 

3. Add to that product another fixed integer K (picked in advance). 

4. Divide the resulting sum by P and pick the remainder as the new random 
integer. Now go back to step 2 and repeat steps 2-4 until you have enough 
random integers. 

This residue algorithm can be written as 

r )+ , = (Mr, + AT)mod P i = 0, 1, 2, . . . 

which says, if we are given a random integer r„ then to compute a new one 
r >* i - we multiply by M, add K, divide by P, and pick the remainder. For example, 
if: 

P = 100 
M = 37 
K = 16 
r„ = 15 

then we would generate the random sequence 



r 
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Note that since P - 100. all the integers are between zero and 100 (the so-called 

eet'die to 5 * ° f rem f a,nd . ers) - B y P‘ acin S a decimal in front of these integers we 

get the sequence of random numbers between zero and one: 

15 
71 
43 

07 (We also call these numbers r,). 

NOTES 

1. Since we are dividing by P = 100 in our random-number generator, the 
remainders will be one of the integers 0, 1, 2, . 99 and hence our 

enure process will start repeating before long. In fact.’our’random numbers 

15, 71, 43, 7, 43, 7, 43, 7, 43, 7, .. . (Cycle of two numbers) 
and, hence, our method is no good. The ideal situation is to generate the 

reoeaVh'can 5,““ °’ 2 ’ ' i ' "‘ } in 3 random f^ion before starting to 

^P C3t : h can be P rove n mathematically that if the numbers M, K, and P 
are chosen according to certain rules, then no matter how we pick the first 
random number r,„ the algorithm will generate the entire residue class So 
if we pick P very large (like 2*’), we are assured that (for practical purposes) 
the process will never repeat. put puses; 

2 ‘ (such as Simpson's rule) are generally better than 

the Monte Car 10 method for evaluating integrals unless we want to evaluate 
a higher dimensional integral like 

1 = I 1 I I r dx d y dz dw 

3 ‘ Hnn« P ^l Sibl ?J° g t nCrate , random sam P‘ es from various statistical distribu” 
tions other than the uniform distribution f{x) = 1, 0 < x < 1 (the usual 
random-number generator). Computer programs are available to generate 

trihmin S3 Th eS fr r ! he bm0mial ’ gamma ’ normal - and manv other dis- 
come r d,s ‘ nbutl0ns occur ln nature and are of interest when it 

comes to modeling the real world. 

PROBLEMS 

1. Write a computer program to estimate the integral 

h:— 
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How accurate is your answer? Plot the graph of your approximation versus 
the number of random tosses to see if it is converging. 

2. Generate a sequence of random numbers via the algorithm 

r,», = (3r, + 4)mod 7 r a = 0 

3. Write a computer program (and flow diagram) to estimate 

/ = J o J a dx dy dz 

What about the accuracy? 

4. How would you generate a sequence of random points inside the triangle 



5. How would you generate a random sample from the statistical distribution 
given in the following diagram: 



In other words, how would you generate a sequence of integers (0, 1, 2} 
where 0 t\nd 2 have probability of .25 and 1 has a probability of ;5? 

6. The Buffon needle problem says that a needle (of length one) tossed ran- 
domly on the American flag (the width of the red and white stripes is also 
one) has a probability of 2/ir of crossing one of the lines between the stripes. 
How would you design a game (and computer program) to evaluate it? 


OTHER READING 

\tonte Carlo Methods hv J. M. Mammerslev and D. C. Handscomb. Methuen and Com- 
pany i London). 1964. This concise book outlines the general principles of the Monte 
Carlo method. Solutions of differential equations, eigenvalue problems, and integral 
equations are given in addition to problems in statistical mechanics, neutron diffusion, 
and radiation shielding. The book also contains many additional references. 
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LESSON 43 

Monte Carlo Solution of Partial 
Differential Equations 


PURPOSE OF LESSON: To show how random games (Monte Carlo 
methods) can be designed whose outcomes approximate solutions to dif- 
ferential equations. A specific game (tour du wino) is described whose 
outcome is the finite-difference approximation to a Dirichlet problem inside 
a square. The game is extended to include solutions to other problems as 
well.- 


In the previous lesson, we hinted at how games' of chance might be designed 
whose expected outcomes were solutions or approximate solutions to problems 
in partial differential equations. This lesson shows how we can design such a 
game to approximate the solution of the Dirichlet problem 



FIGURE 43.1 Board for tour du wino. 
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(After we show how the Monte Carlo method can solve this particular problem, 
we will then discuss more general problems.) 

To illustrate the Monte Carlo method in this problem, we introduce a game 
called tour du wino. To play it. we need a board on which grid lines are drawn 
(Figure 43.) ). 

Now. for the rules of the game. 


How Tour du Wino is Played 

STEP 1 The wino starts from an arbitrary point (point A in our case). 

STEP 2 At each stage of the game, the wino staggers off randomly to one of 
the four neighboring grid points. (In our case, the neighbors of A are B, C, D, 
and £. and the probability of going to each of these neighbors is .25). 

STEP 3 After arriving at a neighboring point, the wino continues this process 
wandering from point to point until eventually hitting a boundary point p,. He 
then stops, and we record that point’ p ( . This completes one random walk. 

STEP 4 We repeat steps 1-3 until many random walks are completed. We now 
compute the fraction of times the wino had ended up at each of the boundary 
points p,. Table 43.1. shows a typical result after 100 random walks. 

STEP 5 Suppose the wino receives a reward g, (g, is the value of the BC at p) 
if he ends his walk at the boundary point p„ and suppose the goal of the game 


TABLE 43.1 Probability of Random Walk Ending at p, 
(along with rewards g,) 


Boundary point p, 

P*(p,) - fraction of times the 
wino ends at p, 

g, = reward for ending 
at p, 

1 

.04 

1 

2 

.15 

1 

3 

.03 

1 

4 

.06 

0 

5 

.17 

0 

6 

.05 

O’ 

7 

.06 

0 

8 

.15 

0 

9 

.03 

0 

10 

.06 

0 

11 

.16 

0 

12 

.04 

0 
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is to compute his average reward R(A) for all the walks. The average reward 


R(A) = g ,£,,(/>,) + gz^AiPi) + . • . HhPAPm) 

The game is completed with the determination of R(A). In our specific same 
with the values of g, and PJjp) given in Table 43.1, we have 

R(A) = 1(.04) + 1(.15) + 1(.03) + 0(.06) + . . . + 0(.04) 


We now tell the reason for playing this game. 

Reason for Playing Tour du Wino 

It turns out that the average reward we just obtained is the approximate solution 
to our Dirichlet problem at point A. This interesting observation is based on 
two facts. 

1. Suppose the wino started at a point A that was on the boundarv of the 
square. Each resulting random walk ends immediately at that point, and 
the wino collects the amount g,. Thus, his average reward for starting 
from a boundary point is also g,. 

2. Now suppose the wino starts from an interior point. Then, the average 
reward R(A) is clearly the average of the four average rewards of the 
four neighbors 

/?(/!) = J [/?(£) + /?(C) + /?(£>) + /?(£)] 

Again, we ask why the wino’s average reward R(A) approximates, the solution 
of the Dirichlet problem at A. We have seen that R(A) satisfies the two equations-— 

/?(A) = i [/?(£) + R(C) + R(D) + /?(£)] ( A an inter ior point) 

R(A) = g, (A a boundary point) 

If we let g, be the value of the boundary function g(x,y) at the boundary point 
Pi> tfien °ur two equations are exactly the two equations we arrived at when we 
solved the Dirichlet problem bv the finite-difference method. That is. R(A ) 
corresponds to rt. , in the tinite-differenee equations 

- 1 

u i.i ~ ^ («/-!./ + -i + it,-.,-. i) (1.7) an interior point 

' u < f ~ *hc solution at a boundary point (/,/) 
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Hence. R(A) will approximate the true solution of the PDE at A. The tour du 
wino game can be summarized in three steps 

Solution of Laplace's Equation by the Monte Carlo Method 

These rules give the solution at one point inside the square. 

STEP 1 Generate several random walks starting at some specific point A and 
ending once you hit a boundary point. Keep track of how many times you hit 
each boundary point. 

STEP 2 After completing the walks, compute the fraction of times you have 
ended at each point p,. Call these fractions P , (/?,)• 

STEP 3 Compute the approximate solution u(A) from the formula 

«(A) = g t P A iPi) + g./L.CP:) + . . . g, s P A (p y ) 

where g, is the value of the function at p t and N is the number of boundary 
points. 

The game tour du wino can be modified to solve more complicated problems, 
as in the following example. 

Solution to a Dirichlet Problem with Variable Coefficients 

Consider the following elliptic boundary-value problem inside a square: 

PDE .u xx + (sin x )u yy = 0 0<.r<tr 0 < y < - 

BC u(x,y) = g(.r,y) On the boundary of the square 
To solve this problem, we replace and sin ,v by 

= f» (y . | — 2 ttjj + itjj _ , ]//i 2 

u yy = [«/+t.y ~ - u ij + «/_ i.;]/A' 2 (Central-difference approximation) 
sin .r = sin Xj 

and plug them into the PDE. The grid points can be seen in Figure 43.2. 
Making these substitutions and solving for t/, ( aives 

Look very carefully at this last equation. The coefficients of it, f , r 
and u . , are positive and sum to one. In other words, the solution 
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FIGURE 43.2 Grid points of the random walk. 

u, t is a weighted average of the solutions at the four neighboring points. Hence, 
we modify our game so that the wino doesn't stagger off to each neighbor with 
probability .25. but. rather, with a probability equal to the coefficient of the 
respective term. In other words, if the wino is at the point (/,/), he then goes 
to the point: 

(/',/' + 1 ) with probability — — 

1 p ' 2(1 + sin Xj) 

( i,j - 1) with probability ) 


(i - 1,/) with probability — r 1 — - 

' 2(1 + sin xj) 

Other than this slight modification, the game is exactly the same as before. 
Modifications for other problems may be more subtle, but the ideas are similar. 
The reader may wish to devise his or her own games to solve other problems. 
The parabolic case is considered in the problems. 

NOTES 

1. Observe that once the fractions P A (p,) (the fraction of times the wino ends 
at p,) are computed, we can then find the solution u(A) for any other 
boundary conditions g, just by plugging the P A {pj) into the formula 

“(4) = gAOV) + g;^(P;l + • ■ • + g K P A (p K ) 

That is. we don't have to recompute new random walks. 
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In many cases, a researcher wants to find the solution of a PDE at only one 
point. If the boundary is fairly complicated and if the PDE involves three 
or four dimensions, then Monte Carlo methods may come to the rescue. In 
fact, Monte Carlo methods were originally developed to study difficult neu- 
tron-diffusion problems that were impossible to solve analytically. 


PROBLEMS 

1. Write a flow diagram for tour du wino to solve the problem 

PDE u xx + Uyy = 0 0 < A' < 1 0 < y < 1 

BC u(x ,y) = g(x,y) On the boundary 


at an interior point. Let the number of horizontal and vertical grid lines be 
arbitrary. 

2. Write a computer program to carry out the flow diagram in problem 1. 

3. How would the game tour du wino be modified to solve 

PDE u xx + x 2 u yv = 0 0 < x < 1 0 < y < 1 

BC u(x,y) = g{x,y) On the boundary 

What is the nature of the random walk? 

4. Can you devise a modified tour du wino game that will solve 

PDE u„ + u rr = 0 0 < -x < 1 0 < y < 1 


0 < a < 1 0 < y < 1 


5. Derive the Monte Carlo game for solving the following parabolic 1B.VP: 
PDE u, = o ru xx - pn, - yu 0 < a < 1 0 < t < x 

IC m(a.O) = <J>(a) 0 s a s 1 

HINT Replace the PDE by the finite-difference approximation from the Crank- 
Nicolson method; solve for u,» lt/ in terms of its five neighbors u,*,,.,. 
i. U/j, ,. and go on from there. 
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OTHER READING 


2S?/£t '^:„rr" 3 ;T i f - ^ • «— **. 

of the Monte Carlo method ' A Sh ° n chap,er i,lus ‘™"P «»e basic ideas 
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LESSON 44 

Calculus of Variations (Euler- 
Lagrange Equations) 


PURPOSE OF LESSON: To introduce the idea of a functional (func- 
tion of a function) and explain how functionals arise naturally in physics. 
A very common type of functional is the integral 

Ay] = l F(x.y,y') dx 

where the functional J is considered a function of y (a function), and the 
integrand F(x,y,y') is assumed known. An example is the functional 

J[y) = l [/« + /*(*)] dx 

We will also show how to find the function y(x) that minimizes V[>>] by 
finding an equation (Euler-Lagrange equation) in y that must always be 
true when y is a minimizing function. This equation is similar to the nec- 
essary condition in calculus that states 


dx 

at those points x minimizing the function f(x). 


One topic that is closely related to differential equations, but which, unfortu- 
nately, many students do not study, is calculus of variations. This lesson, along 
with the next, introduces the subject and shows how PDEs can be solved by 
variational principles. 

Calculus of variations was originally studied about the same time as calculus 
and deals with maximizing and minimizing functitrijs>)t functions d called func- 
tionals). Oneof the first problems in calculus of variations was the Brachistochrone 
problem proposed by John Bernoulli in 1696, which attempts to find the path 


Calculi 
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FIGURE 44.1 Brachistocrone problem (original problem in calculus of 
variations). 

Bernoulli showed that the sliding time T could be written 


( L dt [ L ds 1 f L ds 1 ( 

A v = vWi vrwl 


and, hence, the total time 7X>’] can be thought of as a function of a function. 
Since many functionals in nature are of this type, it will suffice for us to study 
the general form 


-/Lv] = [ F(x,y, 


With this motivation in mind, we now state our goal in this lesson: to find 
functions y(x) that minimize (or maximize) functionals of the form (44.1). The 
strategy for this task is somewhat the same as for minimizing functions f(x) in 
calculus. There, we found the critical points of a function by setting f'(x) = 0 
and solving for x. In calculus of variations, things are much more subtle, since 
our argument is not a number, but. in fact, a function itself. However, the 
general philosophy is the same. We take a functional derivative (so to speak) 
with respect to the function y(jr) and set this to zero. This new equation is 
analogous to the equation 


from calculus, but now it is an ordinary differential equation, known as the 
Euler-Lagrange equation. The remainder of this lesson is devoted to finding this 
equation and solving it for specific problems. 



! 
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Minimizing the General Functional J[y ] = J q F(x,K,K') dx 

We consider the problem of finding the function v(x) that minimizes the func- 
tional 

»'ly] = f F(,v, y.y') dx 

from among a class of smooth functions satisfying the boundary conditions 

y(a) = A 
y(b ) = B 

See Figure 44.2. 


; 

_y(*l * minimizing i 

unction v yr^ s > 

.yt.vl + eijtxl 

variation from 




\ !)(*) ! 


FIGURE 44.2 The variation of a function. 

To find the minimizing function, call it y, we introduce a small variation from 
v(a): namely. 

y(jc) + e-nW 

where e is a small number and t)(x) is a smooth curve satisfying the BC -n(o) 
= x](b) = 0; they are shown in Figure 44.2. It should be clear that if we evaluate 
the integral J at a neighboring function y + eq, then the functional J will be 
greater; that is, 

J\y) « J\y + F.-n] 

for all r.. In other words, if we graph the function 4>(e) = J[y + F/q] as a function 
of e. we will have a graph something like Figure 44.3. 
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FIGURE 44.3 Graph of J[y + | n a neighborhood of , . 0. 

With Figure 44.3 in mind, ou, strategy for finding .Jr is , akc , he derivative of 
<M<0 = J\y + ET)) 

with respect to e. evaluate it a, , . 0. and set this equal to zero; that is. 



(Th ' rSad " !hould ‘‘"I ■>"> >“* >KP0 From integration by pans, we have 

~l {f " S [^]} T 'W * * 0 

S.“ i m S' i S H Sa,i!,yi " 8 bd “" da ^ 

■he integrand mas, be zero; , 'ha. is ’ "" remaini "S 1“"™ <* 

(44.2) ~ - jL M 

dy dx [t)y'J ~ ® (Euler-Lagrange equation) 
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Solving this simple differential equation with BCs )'(0) = Oand v(l) = 1 gives 
y O) = 0.42C - 0A2e~ x 

which is shown in Figure 44.4. The claim here is that any other smooth curve 
y(jr) passing through the two boundary points will give rise to a larger /[v]. 



FIGURE 44.4 All possible smooth curves satisfying the BC y(0) = 0 and 

A 1 ) = 1 . 

NOTES 

1 . The Euler-Lagrange equation is analogous to setting the derivative equal 
to zero in the calculus. If the reader remembers, we don’t always find the 
minimum (or maximum, for that matter) by this process, For example, the 
function f(x) = x ’ has zero derivative at x » 0, but this point is neither a 
local maximum nor minimum; the same holds true with the Euler-Lagrange 
equation. We should think of it as a necessary condition that must be true 
for minimizing functions but may be true for other functions as well. Quite 
often, however, the solution of the Euler-Lagrange equation will be a local 
(in fact, global) minimum by the very nature of the problem; we can often 
tell if this is the case. 

2. The minimum y(x) of the functional 



is the curve that gives rise to the minimum surface area of revolution when 
we rotate y(x) about the jt-axis (Figure 44.5). 

The solution of the Euler-Lagrange equation with BCs y(a) = A and y[b) 
= B is part of the hyperbolic-cosine curve (catenary) 

y(x) = a cosh [(a- - p)/a] 

where the constants a and (3 are determined so that the curve passes through 
the end points. This is a fairly difficult equation to solve, although the reader 
could verify that the hyperbolic cosine does satisfy the equation. 
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FIGURE 44.5 Minimum surface of revolution. 

3. We could evaluate the functional 

J \y) = l L> ,: +y' 2 ]dx 

that was minimized in this lesson for the minimization function 
y(x) = 0.42e* - 0.42c J 

to see that 7[y] = 0.46. If we substitute any other smooth function y(x) 
passing through the end points (0,0) and (1,1), we get a larger value of/[y]. 

4. Basic principles of physics are often stated in terms of minimizing principles 
rather than differential equations. Fermat's principle (a light ray requires 
less time along its actual path than along any other path having the same 
end points), Hamilton’s principle (in a conservative force field, a particle 
moves so as to minimize the action integral 

f t (kinetic energy - potential energy) dr 

are examples of nature behavjng in such a way that minimizes functionals. 

5. Calculus of variations ideas can also be used to minimize important multiple- 
integral functionals like 

/[«] = j o j F(x,y.u,u„u r ) dx dy 

where the corresponding Euler-Lagrange equation is 

F„ ~ T f -. ~ T f » m 0 (A PDE) 
dx * dy ’ 

In fact, these functionals are the ones that we will be concerned with in the 
next lesson, since the Euler-Lagrange equation is a PDE. Our general phi- 
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losophy, however will i- 
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3. Show that the minimizing function y( x ) for the functional 


J \y\ = l [y‘ 2 - f] dx 


with BCsy(O) = 0 and v(tt/ 2) = 1 is vf,) = sin _ Pua . , „ . s 
4. Derive the Euler-Lagrange equation ™ 7(S1 " * } - 


y f M ) = ]J F (x,y,u,u„u y ) dx dy 


OTHER READING 


LESSON 45 


Variational Methods for Solving 
PDEs (Method of Ritz) 


PURPOSE OF LESSON: To show how differential equations can be 
solved by interpreting the equation as the Euler-Lagrange equation of 
some functional and then finding the minimizing function of the functional 
(bv some new method). The minimizing function will then be the solution 
of. the PDE. The problem, of course, is to find the functional that has the- 
original equation as its Euler-Lagrange equation. A well-known result 
( minimum-energy theorem) is presented that says finding the solution u to 
certain elliptic BVPs like 

u a + = / In a region D 

u = 0 On the boundary of D 

is equivalent to finding the function u (also zero on the boundary of D) that 
minimizes the potential-energy functional 

,J[u] = JJ [ u 2 + u 2 y + 2uf] dx dy 

That is, = /is the Euler-Lagrange equation of J\u] . An approximate min- 
imizing function of 7(u] is found by the Method of Ritz, and so we have the 

solution (an approximation) to the PDE. The method of Ritz will be discussed 

and a functional minimized using this technique. 


There is a very nice way to solve boundary-value problems (like the stretched- 
membrane problem) by looking for the smooth surface that minimizes the po- 
tential energy of the membrane. That is, if we think of our PDE as being the 
Euler-Lagranee equation of some functional /[it], then we can solve the differ- 
ential equation by minimizing the functional (since the minimizing function of 
the functional is also the solution of the corresponding Euler-Lagrange equa- 
tion) In Lesson 44. we only considered functionals where the Euler-Lagrange 
equation was an ODE. This lesson considers functionals where the Euler-La- 


grange equation is a PDE. for example, the functional 

■/[«] = l l l«; + "?] dx < v 

has as its Euler-Lagrange equation (proof similar to the ODE case in the last 
lesson i 


M„ + H,., = 0 

and so to solve the Dirichlet problem in the unit square 

PDE u„ + u,, = 0 0 < x < 1 0 < v < 1 

BC u - g On the boundary of the square 

we can alternatively find the function u{x,y) that is equal to g on the boundary 
and minimizes J[u). It probably comes as no surprise that the functional 

y[M] = l [ [u; + «;] dx dy 


represents the potential energy of the membrane, and so what we are, . in fact, 
doing is finding the minimum potential-energy surface. The question, of course, 
is, given a differential equation, how do we find the functional J[u) that represents 
the potential energy of the solution? The answer to this question is given in a 
well-known theorem (minimum-energy theorem) that states: 

The solution u of the Dirichlet problem 

PDE Vh< = f In a region D 
BC u = 0 On the boundary of D 

is the same function u that minimizes (among those functions having BC u — 
0) the energy functional 

/[it] = JJ [u* + u; + 2uf] dx dy 

This theorem is stated for other types of BCs and is proven in the reference of 
Other Reading. To help understand the theorem, we present an example. 
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FurStoS P ° isson ' s E< ^ uation by Its Potential-Energy 

Consider the Dirichlet problem 

(45.1) PDE u „ + u yy = / 0 < * < 1 0 < y < l 

See Figure 45. “ = ° ° n the boundar y of the square 



« *o 


FIGURE 45.1 Poisson's equation inside a square. 

Here, the energy functional J[u] is 

(4 «» « = |' J (W' +u » + 2„/| < xdy 

Method of Ritz for Minimizing Functionals 

This method is only one of several discussed in the reference of d a- 
The idea was introduced by the mathematician W Ri tz and is ! ! Read,n S- 
consists of the following steps: d S qu,te s,m P le; 11 

STEP 1 Replace the function u in the functional 

~ i. .[ f"' f + -."/I tlx dy 
by an approximating function (the user picks n) 

».,(x.y) = «,<!>, (-V.„v) + «,<b,(.i-. V ) + ••• + (/„(b„(.v.v) 
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This all looks pretty complicated, but if we rewrite these two equations in matrix 
form, we have the system of linear equations 



A - (A u ) is the n >; n matrix with elements (can be computed) 

, 45 . 3 ) 

. 1 " J" |_ dx dx dy dy J 
b = (6,) is the vector with components 

( 45 - 4 ) b, = - J t /(x,y)4>i(x,y) dx dy 

and 

a = (a,) is the unknown vector whose elements represent the coefficients 
in the approximate solution u„(x,y) = a,4>i(;c,y) + . . . + <?„<|>„(A: ( y). 

STEP 3 Solve the linear system Aa - b for the coefficients a t , a 2 . ... , a„. 
Hence, we have the approximate minimizing function 

“n(x,y) = a.Mx.y) + a 2 <|> 2 (.r,y) + . . . + a„4>„(j:,y) 

and, hence, an approximation to the solution of Dirichlet problem (47.1). 

NOTES 

1. The Ritz method was used to minimize double-imegral-type functionals in 
this lesson. It could also be used to minimize functionals like 

•%] = l [r + y' 2 ) dx 
v(0) = 0 y(l) = 1 

The only difference here would be that approximation by functions <J>,. 4>,. 

<t >3 4>„ in y„(x) = a,^, + a 2 <$> 2 + ... + a„<\>„ would have to satisfy 

the BCs 

4>,(°) =0 

<t>.d) = 1 
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" doubTe n integra7 n ‘ eSS ° n ‘ ha ‘ the Eulcr ' La g r ^ge equation of the 

A u \ - j u j[ («; + u;] dx dy 

is Laplace s equation , but the proof is analogous to the arguments in Lesson 
44 m the single-integral case. 

3. In the reference of the recommended reading, we show how to construct 
the energy functional J[u] for many other differential equations (other than 
Poisson s equation) and for many other kinds of BCs (other than Dirichlet 
type u - 0). Hence, many kinds of BVPs can be solved bv minimizing the 
corresponding energy functional. 

4. The larger we pick «, the smaller the actual value of 7( u „). and. hence, the 
more accurate the solution to the differential equation. One strategy would 
be to compute u n (x,y) for larger and larger values of n and see how much 
J[u„] is decreasing. 

5. For all practical purposes, computations in the Ritz method would have to 
be carried out on a computer unless n was very small. The flow diagram in 

'l |ustrate s the computations we would make in order to solve 
BVP (45.1) by the Ritz method. 

The user would have to provide a subroutine to define the functions «!>,. d> 2 , 

• . .. <p„ and evaluate them. This could be done in a subroutine like the 
following: 

SUBROUTINE BC (X,Y,PHI) 

C SUBROUTINE PROVIDED BY THE USER TO EVALUATE THE 
C FUNCTIONS PHI(1),PHI(2) PHI(N) 

DIMENSION PHI(20) 

PHI(1) = X*Y*(1 -X)*(1- Y) 

PHI(3) - y*PHI( 1) (thCSe arC * he functions we vc been usin &) 


PHI(N) = (whatever it is) 

RETURN 

END 
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1. What would be the energy junctional J[u\ corresponding to the following 
problem: 

PDE tr„ + u, y =1 0 < x < 1 0 < y < 1 

BC u = 0 On the boundary 
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2. How could we minimize the functional 

Ay] = [ [r + V' 5 ] dx y(0) = 0 y(l) = 1 

by the method of Ritz? 

HINT If we introduce a new function -(/) 

z(t) = (1 - x)y(t) 

we note that z{t) satisfies z(0) = 0 and ;(1) = 0. 

3. Write a computer program to carry out the computation in Figure 45.2. 

4. Show that the Euler-Lagrange equation of the functional J[u] 

J[u\ = J ( J f [w; + «;] dx dy 
is 

+ u„ = 0 

5. The Dirichlet problem 

u i, + u yy - sin (nx) ■ 0 < .v < 1 0 < y < 1 

u = 0 On the boundary of the square 

can be solved by the finite sine transform (transform the .r-variable) and has 
the solution 

- tt(x r y)-= ^4e" v + Be-*” - sin (ir.r) 

where A = 0.06 and B = 0.04. How would we find the potential energy 
of the solution? It would be a good review for the reader to use the sine 
transform and find this solution u(x,y). 


OTHER READING 

Variational Methods in Mathematical Physics bv 5. G. Mikiin. Macmillan. 1964. This 
book discusses many types of methods for minimizing functionals and how these results 
can be applied to solving PDEs. In addition to the Ritz Method, the well-known method 
of Galerkin is discussed; see Chapters 3-4. 
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LESSON 46 

Perturbation Methods for Solving 
PDEs 


PURPOSE OF LESSON: To show how different problems (nonlinear, 
equations with variable coefficients, irregular domains) can be solved by 
perturbing easier problems. In other words, to show how the solutions to 
easy problems can be modified so that they approximate solutions to hard 
problems. .... 

For example, we will show how the solution to the nonlinear problem 

PDE V : u + « : = 0 0 < r < 1 

BC u(l,0) = cos 6 O=s0*s2tt 

can be approximated by perturbing the solution u(r,0) = r cos 0 to the linear 
Dirichlet problem 

PDE = 0 0 < r < 1 

BC u(l,0) = cos 0 0 « 0 s* 2ir 


Quite often a problem whose solution is known can be continuously changed so 
that nearby problems can be solved by a gradual modification of the solution 
of the first one. That is, we continuously modify (perturb) the original problem 
(and its solution) in a gradual way so that nearby problems are solved. 

For example, Laplace’s equation 


can be continuously modified via the family of problems 
V : u + Eir = 0 0 « e =£ 1 

so that we arrive at the new nonlinear equation 
+ w = 0 
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In this way. we can attempt to solve nonlinear problems by modifying the solution 
to Laplace's equation (Figure 46.1). 


<t = 0) (0 < r --- i) <i = n 



FIGURE 46.1 Schematic diagram of perturbation methods. 


In seeking the solution to the perturbed Laplace equations 
V J u + zir = 0 

we modify the solution u„ of Laplace’s equation by adding on small perturbations. 
It seems reasonable that the perturbed equation 

• V 2 u + em : = 0 

should have a solution of the form 

(46.1) U = U„ + EM, + e j u 2 + . . . 

Note that power series (46.1) in e agrees with Laplace’s solution u - u v when, 
6 = 0 and will be the solution of the nonlinear problem (if it converges) 

V J w + ir = 0 

when e = 1. In other words, equation (46.1) acts as a vehicle that allows us to 
go from Laplace’s equation to the nonlinear one. The problem is to find the 
functions u,, «,.... in power series (46.1). For the remaining part of this 
lesson, we will show how different boundary-value problems can be solved by 
this general principle. 


A Perturbation Solution ot the Nonlinear Equation 

V 2 u + u 2 = 0 

Suppose we would like to solve the fpllowing nonlinear Dirichlet problem 

(46.2) PDE V : /< + u'- = 0 (!</•<] 

BC m( 1.0) = cos 0 (l s n s; 2 tt 
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The idea here is to think of this nonlinear problem as a perturbation of the linear 


(46.3) PDE V-u = () 0<r<t 

BC n(1.0) = cos 0 0 8 =£ 2 it 

which has the solution u„(r, 0) = r cos 0 and ask how to modify u„(r.0), so that 
it satisfies problem (46.2)? As we mentioned earlier, we introduce a class of 
problems V 2 u + eh 2 = 0 and look for solutions of each of these equations of 
the form 

(46.4) u(r,Q) - M o (r,0) + ett,(r,0) + e 2 H,(r,0) + . . . 

In this way, we find the solution of our nonlinear problem (46.2) by letting e 
= 1. Substituting our perturbed candidate (46.4) in the perturbed problem 

PDE V 2 u + eh 2 = 0 

BC u(l,0) = cos 9 

we get 

V 2 (« n -f- EH, + E 2 H, + ...) + e(h„ + EM, + E 2 H, + . . . ) 2 = 0 

W„(1,0) + EU,(1,0) + E 2 U 2 (1,0) + . . . = COS 9 

Performing a little algebra and setting the coefficients of the powers of e equal 
to each other, we arrive at the following sequence of problems P n , P„ P,, . 

from which we can solve for our unknown functions h„, m„ . . . (note that the 
problem are linear and nonhomogeneous ): 


V 2 u„ =0 0 < r < 1 

u„(l,0) = cos 9 

V 2 H, = - H 2 
H,( 1 .9) = 0 



«„ (r,0) = r cos 0 
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I 

I 

! Let’s start by finding M,(r,0) from problem P, (we already know i/„); we have 

i , r 2 r 2 r 2 

. p J V 2 m, = - r 2 cos 2 0 = - - (1 + cos (20)) = — - — -cos (20) 

^ l«,(1.0) = 0 2 2 2 

j To solve this nonhomogeneous problem, we resort to a technique that the reader 

may recall from ODE theory and that consists of the following: 

1. Finding the general solution v h of the homogeneous equation 
j 2. Finding a particular solution y p of the nonhomogeneous equation 

3. Substituting y h + y p into the IC and solving for the constants 
! This technique will work for this specific problem. In our problem P, , the general 

form of the homogeneous solution of 7 2 u = 0, 0 < r < 1 is chosen' as the 
separation of variables solution 

| “i,(r,to) = 2 r"[a n cos («0) + b„ sin («0)J 

Now, to find a particular solution (just one solution) of the nonhomogeneous 
equation 

V 2 m = - r — - jcos (20) 

We try 

j u P ( r .0) = Ar* + Br* cos (29) 

I 

[Inputs of r", r cos (/t0), r sin («0) give rise to solutions of the form Ar"* 2 . 
Br"* 2 cos (/t0), Cr"* 2 sin (n0). respectively]. Substituting u p (r, 0) in the non- 
homogeneous equation gives 



Thus, we have 

t< P (r.Q) = - ~ - 7" cos (20) 
j2 24 

Our final step in solving P, is to substitute the general solution u(r, 0) = 
u /i(f-9) + u ; ,(r,0) in the BC ul l.ft) = 0 and solve for the coefficients a., and 
Doing this, we get . • 

E K sosJ^/tB) +. h.. sin («»)] - — _ i. cos (20) = t) 
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and, hence. a„ = 1/32. a : = 1/24. and all the othei 
words, the solution of problem P , is 


and />' s are zero. In other 


The function u,(r,0) is called the first perturbation of n«(r,0) and by adding it 
to u n (r,0). we have the new approximation 

_ n 


to problem (46.2). To find the next perturbation ir 2 (r.0), we must solve 

j V : h, = - 2u„u, 

- \m 2 ( 1*6) = 0 

where ir„(r,0) and w,(r.0) are substituted in the right-hand side of this equation. 
Needless to say, without the help of a computer to carry out these algebraic 
manipulations, this would be a significant problem in itself. Fortunately, equation 
(46.5) is a fairly accurate solution to our problem. In fact, if we substituted this 
approximation in the left-hand side of our nonlinear equation 


we could see that it is almost zero everywhere inside the circle 0 < r < 1. 

In addition to solving nonlinear equations, perturbation theory can also be 
applied to solving problems with irregular boundaries (as long as they're not too 
irregular); we now present a simple example, 


An Example of a Boundary Perturbation 

PDEs aren't the only things that can be perturbed. We can find the solution of 
Laplace's equation inside a deformed circle by perturbing the solution of La- 
place's equation inside a circle. For example, suppose we want to find the 


potential inside the region r 


i 0 with the potential « given on this 


V : w = (I 0 < r < 1 + - si 
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See Figure 46.2. We could think of this problem as describing a soap film inside 
a deformed circle where the height of the wire is cos 0. 

Since the general philosophy of perturbation procedures is to rewrite a difficult 
problem in terms of an easy one, we think of the BC on the deformed circle 


as just the extreme BC in the family of BCs 


u(l + e sin 0. 0) = cos 0 


See Figure 46.3. This idea leads us to think in terms of Taylor's series. Using 
a Taylor series like 


f(x + h) = f{x) + f(x)h + /"(a) - 



BC on ihe c-'.le r = 1 
(Simple BC) 

FIGURE 46.3 Schematic illustration of perturbation procedures. 


Perturbation Methods for Solving PDEs 375 


we can expand the hard BC in terms of the easy one; that is. 

u(l + e sin 6.0) = «(1.0) + m,(1.0) (e sin 0) + u„(1.0) -■ St " + . . . 

Substituting this in our original problem gives us the new equivalent problem 
(we will, of course, let e = 1/4 when we get done) 

V 2 h = 0 0 < r < 1 -+- B sin 0 

(46.7) 

“(1.0) + “,(1.8) (e sin 0) + M „(l,0) 9)2 f . . . = cos 0 

This, of course, doesn’t look like an easy problem either, but we can now divide 
the problem into a sequence of problems where we can separately find the 
functions u a , u lt u 2 , ... in the desired solution 

(46.8) u = u„ + e u, + e 2 u 2 + . . . 

If we substitute this series into problem (46.7), we get the following sequence 
of problems from which we can find u„, u„ . . . 


f V 2 u 0 - 0 0 < r < 1 (Inside a circle ) 

{ «o(l,0) = COS 0 

V 2 u t = 0 0 < r < 1 (Inside a circle ) 

u,(l,0) = - sin 0 - n ^’ 9 ^ = - sin 0 cos 0 


Hence, we can solve each of these Dirichlet problems (inside the circle) for u„, 
n„ u 2 , ■ ■ ■ and so obtain the solution 



(note that we have let e = 1/4) of the Dirichlet problem in the deformed re«>ion 
The reader will get a charge to find the first perturbation //, and check the 
approximation 
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Note that the two displayed problems have constant coefficients. The reader 
should be aware that e in the perturbation equation must be small or else the 
infinite series will not converge. 


PROBLEMS 

1. Substitute equation (46.8) in problem (46.7) to find the sequence of problems 
P,„ 7\ 
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2. Show that ihc nonlinear problem 

V ; rr + u'- = 0 0 < r < 1 

h( 1.0) = cos H 

gives rise to the sequence of linear problems P„, P,. P : . ... as shown in the 
lesson. 

3. Substitute equation (.46.5 > in the nonlinear problem 

+ U 2 = 0 
«(1.0) = cos 0 

to check its accuracy. 

4. Solve problem P ] in the boundary-perturbation problem and check how well 
u(r.6) = u„(r,6) + j u,(r, 0) satisfies 

V J w = 0 

«(1 + J sin 0,0) = cos 0 


OTHER READING 

Partial Differential Equations: Theory and Technique by G. F. Carrier and C. E. Pearson. 
Academic Press. 1976. Chapters 8 and 15 will give the reader a good idea of many of the 
facets of perturbation theory: an excellent reference text. 
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our transformation u = u(x.y). v = eU.y) in this solution to obta.n our 
soiution <t>[u(x.y). v(x .y)j ,n terms of the original .r.v coordinates 
This lesson will show the reader: 

1. The nature of conformal mappings 

2. How to construct them (to a certain extent) 

3. Examples of problems solved using this technique 


One of the major difficulties in solving boundary-value problems is due to com - 
plicated boundaries ; even relatively simple boundaries can often cause a problem 
UD be very difficult. One way. of course, to attack irregular boundaries is bv 
means of perturbation methods, but this generally works only if the boundary 
is close to a simple boundary. 

There is a way however, to solve Laplace’s equation in two dimensions when 

y 8Cne ’ th3t iS by apP ' ying COn f° rmal ma PP in SS- 
snendTl Ttf- gCt T the actual a PP lication of this technique, we must 

2 httle j* me . talkln g about the concept of a conformal mapping and about 
complex numbers in general. 5 " u uuuul 

Conformal Mappings and Complex Functions 

This lesson presents only a few ideas from complex variables that will be needed 

r®"" “ mP " X n “ mb “ 2 = ‘ + " “ 8 *" • 


y (Complex axis) 



FIGURE 47.1 Complex z-plcne and useful formulas. 

idearf ,h ' “? of * "»PPing. mm in.roduee ,h e 

iaea ot a function of a complex variable 

•v = f{z) 
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Here, z is a complex variable (that has some domain in the complex z-plane), 
and w = u + iv is a new complex variable (that will run around according to 
the formula f{z) in a new complex w-planej. For example, the complex function 
w = z 2 defined in the first quadrant of the complex z-plane will map this domain 
onto the entire upper half v > 0 of the complex w-plane. In particular, tv = 
will send the following points of the ;-plane onto the corresponding points of 
the iv-plane: 

TABLE 47.2 


z-plane 

z z 2 w-plane 


0 

--1 

: t2i 

t-axis — — 

— * Positive real axis 

First quadrant - 

»' Upper-half plane 


See Figure 47.2. 



FIGURE 47.2 Mapping the first quadrant of the z-plane onto the upper 
w-plane. 

In other words, when we talk about functions of a complex variable w = /(z ) 
(in contrast to functions of a real variable, which the reader is already familiar 
with), we dis’cuss how curves in the z-plane map onto curves in the w-plane. 
Before going on, the reader should know how complex mappings like w = z 2 
can be written in an equivalent real form. The real form tells us how the original 
coordinates (.v.v) in the z-plane map onto the new coordinates Ut.v) in the iv* 
plane. To find the real form of the mapping, we merely write w = z 2 as 

and. hence, setting the real parts equal to the real parts and the imaginary parts 
equal to the imaginary parts, we have 
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This form will be useful later. In this particular case, this form is interesting 
because it says that hyperbolas in the r-plane map onto the coordinate lines it 
= constant, v = constant, in the complex w-plane. 

We now get to the special kind of functions, functions of a complex variable 
known as conformal functions (or conformal mappings). 


Definition of a Conformal Mapping 

We say that a mapping tv = f(z) between the complex 2 - and w-planes is 
conformal at a point 2 ,, in the e-plane if the derivative f(z„) =f 0. What's more, 
we say that f{z) is conformal everywhere in a region D of the e-plane if f(z) 
r 0 everywhere in D. 

For example, /(e) = e 3 is conformal everywhere except at e = .0. since f(z) 
= 2z =* 0 for all e =£ 0. On the other hand. e : is conformal everywhere in the 
e-plane, since f(z) = c : * 0 everywhere. The question, of course, is why 
conformal mappings are useful? The answer is that in solving Laplace's equation 
4>„ + 4> v , = 0 inside some domain of the xy-plane, we can think of the jry-plane 
as the complex e-plane and introduce a complex mapping w = /(e) from the e- 
plane to a new w-plane. The tv-plane has coordinates (w,v), and so the original 
Laplace equation + <!>,., = 0 will be transformed into a new PDE in coor- 
dinates wand v. The point is that if the mapping w = /(e) is conformal everywhere 
in the domain of <b„ + 4>,, = 0, then the new transformed PDE in the new 
coordinates u,v will still be Laplace's equation (in the new coordinates u,v).' 
That is, 4>„ + <b,,,. = 0 is transformed into the equation. 4w + = 0. So, the 
idea is to find a conformal mapping that changes the original complicated bound- 
ary to a simple one (remember tv = z- changed the boundary of the first quadrant 
of the z-plane to the real axis of the tv-plane). 

We now present a few examples to show how conformal mappings can be 
used to solve PDEs. 

Laplace's Equation in the Upper-Half Plane 

Suppose we wish to solve the following Dirichict problem in the upper-half plane 
(Figure 47.3): 

PDE <b„ + d>,. v = 0 -*<*<* 0 < y < * 

(47.1) 

BC cb(.v.O) = 

One way to solve this problem would be to apply the Fourier transform to the 
v-variablc. but an easier method is to conformally map the upper-half plane v 
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FIGURE 47.3 Boundary-value problem in the upper-half plane. 


> 0 to a new region of the uv-plane. With a little effort, the reader can see that 
the conformal mapping 



has the following properties (see Figure 47.4): 



FIGURE 47.4 Conformal mapping of a hard problem into an easy one. 

L It maps the upper half of the r-plane conformally onto the region -* 
< u < *, 0 < v < tt of the w-plane. 

2; The line segment y = 0, - 1 < x < 1 in the 2 -plane (where the potential 
4> is one) maps onto the line v = it, -a < u < « in the w-plane. 

3. The two segments x > 1, y = 0 and x < — 1, y = 0 in the e-plane map 
onto the positive and negative u-axis of the w-plane. respectively. 

The reader should make sure that he or she can verify these statements. The 
importance of these properties lies in the fact that the original problem (47.1) 
is now transformed into an easy one 


(47.2) 


PDE 

BC 


4> u „ + <t> v , = 0 
U(u.0) = 0 

[<t>(u.Tr) = 1 



0 < v < it 
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The reader should check the graph of this function along various lines y = c to 
get an idea of what it looks like. 

For our second example, we transform a region between two nonconcentric - - 
circles into an annulus. 


Dirichlet Problem Between Two Nonconcentric Circles 

Suppose we wish to find the potential d>(^r.y) between the two circles 

,r : + v- = 1 
U - [)- + v- = 9 

where the potential on the inside circle is one and two on the outside circle 
(Figure 47.5). 
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i 

i 

i 




FIGURE 47.5 Conformal map onto an annulus. 

In other words, our original problem is 

, PDE <j>„ <t»™ — 0 Inside D 

(47.3) 

f 4>(jr,y) = 1 Onx* + y 2 =l 
\<t>(x,y) = 2 On (.v - l) 2 + f = 9 


The problem now is to find a conformal mapping that will transform this domain 
into a nice easy one where our problem will be simple. In this case, it seems 
obvious to seek a transformation that maps our domain into an annulus. This 
is not a well-known transformation, but there are sources that will provide us 
with just the proper mapping. One of the more elaborate sources, The Dictionary 
of Conformal Mappings by H. Kober (Dover Publications), will provide the 
reader with hundreds of mappings between the common domains. Assuming 
that the reader is willing to spend a little time getting familar with the tables, 
he or she can find the desirable conformal transformation for the problem (47.3). 
In our specific case, it turns out to be the mapping 



where s = -0:146 and t = -6.85. In the equivalent real form, it is 

(47.5) * = y ((* - s)(x- t) - f] 

v = y \y(x - t)] 


where 
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■ill transformation, the original nonconcentric circles map 
; + i- ; = 1 and u : + r : = 6.86 (the reader could check 


tow apply this conformal maping l< 
he new Dirichlet problem inside at 


r original problem (47.3). we 


PDE dj,„. - d),, = (I In the new annulus 

U(n.v) = 1 On u 2 + v= = 1 
u [Mu.v) = 2 On u 2 + v* = 6.68 

The answer to this problem is not difficult, since we can see that the solution 
will be radially symmetric and we know that all radially symmetric solutions to 
Laplace's equation are of the form 


Substituting this equation in the BCs of (47.6), we get 
<K«, v) = 0.57 In (w 2 + v 2 ) + 1 

and so if we substitute back to our original coordinates x and y by means of the 
transformation (47.5), the answer to problem (47.3) is <t>(*.,y) 

4>(*..v) = 0.57 In (w 2 + v 2 ) + ] 

where u and v are given by equations (47.5). 


The Schwarz-Christoffel transformation is a procedure for constructing con- 
formal mappings from fairly general regions of the z-plane to the upper half 
of the w-plane (of course, once the problem is transformed into the upper- 
half plane, we could transform again into yet another region). This method 
is described in reference 1 of the recommended reading. 

The conformal-mapping method is somewhat restrictive because it applies 
only to Laplace's equation in two dimensions (although, with a little mod- 
ification, it can be applied to Poisson's equation). 


Where is the mapping 
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conformal? Convince yourself that it maps the upper-half r-planc onto the 
strip -v- < u < x. 0 < r < tt of the w-plane. 

2. What is the image of the first quadrant under the mapping w = z’? It might 
be helpful to write the complex numbers in polar form 
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HINT The complex function >v = log z = log |z| + / arg (z) maps the ray 0 
= c, of the z-plane onto the line v = c, of the w-plane and the curve r = c, 
onto the line u = log c 2 (log, of course, always means natural logarithm). See 
the figure that follows. 



OTHER READING 

1. Complex Variables and Applications, 3d ed. R. V. Churchill. J. W. Brown, and R. F. 
Verhey. McGraw-Hill. 1977. This book is one of the best and contains a good chapter 
on the subject of conformal mappings, which can be thought of as a part of complex 
variables, along with applications of PDE. 

2. Dictionary of Conformal Mappings by H. Kober. Dover, 1960. This paperback will 
provide the reader with a list of conformal mappings. 
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ANSWERS TO 
SELECTED PROBLEMS 


(a) Second order, linear, nonhomogeneous. parabolic, constant coefficient coeffi- 
cients, two independent variables. 

(b) Second order, linear, nonhomogeneous, parabolic, constant coefficient coeffi- 
cients. two independent variables. 

(c) Second order, linear, nonhomogeneous, hyperbolic, constant coefficient co- 
efficients, two independent variables. 

(d) Fourth order, nonlinear, two independent variables. 

Yes. if G = 0. 

Uj = 0 implies u(x, y) = g(y). 

u xy = 0 implies u(x, y) = f(x) + g(y). 


u(x, t) approaches zero for all x as t — oo. Try u(x, t) = e° 

m— &&-*)+* 

U{x) = 7 ====- [sinh \J 13/ a 2 x + sinh y/P/a2 (1 - x)] 

srnh v/?/a 


Heat flows into the rod at the right end at a constant rate while the left-hand side 
is kept at zero degrees (zero can stand for any temperature). Keeping the left 
hand of the rod at zero actually means it will be a heat sink. 

Both ends of the rod are insulated so the total heat energy inside the rod will 
eventually become distributed uniformly. 
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5. n(r.t) = f .silt (2 M.r) -f sin (4— ./■) 4- i" 1 ' s j„ ( G it:/- ) 

6. u(x. /) = 4j ' ''' sin (-.r) + sill (3rr.r) + ••• j 

LESSON 6 

1. ii(a\ Ij = .(■ T f sillier) 

2. u(x.1) = x - |e _ " 4 5 'sin(sr.r) + ^c _(3,r, *‘ »ii (3 jt«) + -I 

LESSON 7 

1. w(.r. t ) = a) c~ {n/2rl sin (-.r/2) + a 3 e~ (3 * /2)2i sin (3?rx/2) H 

where a 2 n-u =2 f x- sin [(2n + l)7rx/2]dx 
Jo 

2. A„ = (n7r/2) 2 , X„(x) = sin (nirx/2) (n = 1.3. 5. • • •) 

3. u(x,t) = \ - ^ XJ ^~ {nn)2l .cos(n7rx) 

LESSON 8 

U(x. 0 = f; sin [(2n - l),rx] 

2. u(x./) = x- fe"' |e- r '‘sin(7rx) — ^e- (2,r)J 'siii(27rx) + - .J 

3. «(x. <) = e _(r +1)< sin (7rx) 

LESSON 9 

2. u(x.l) = ^|1 - e _7r2t ] sin (ttx) + ~ e - ^ 1 ] sin (2?rx). 

3. u(x./) = + ^[1 -e- , ' J ']|sin(xr) 

4. u(x.t) = A-[l - ( ~ A, 'j sin (A|;r) where Ai is the smallest root of tan A = -A. 
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LESSON 16 

2. look, «, sin „ ; ta , vibra , C5 , 0 z „ 0 touse of , he ^ 
4. u(x.t) = C|e ,,(x - ( ) +c 2e , K*+M 

LESSON 17 

3. ti(;E. 0 = Ije-t-'-O 3 + e -(x+e)-j 

4. a(*.'t) = 

LESSON 20 

' • U(X ' t) = Sin «* («*/*> + 5 sin f3«/L) cos (JhrQt/L) 

2 ' U(Z ’ = { 3^ } S ‘ n ^* X / L ) sin (3 nat/L) 

4. u(x,t) = sin (37rx/Z.}(sin(37Tftt/L) + cos(3~at/L)) 

5. u(x. t) = — sin ttx cos nt — ~ sin 3rrx cos 3? rt -I 

LESSON 21 

2- u(z, t) = sin { rx) [cos(v 2 t) + ± sin (r* t )J 

3. u(x. t) = ^r b„ cos (n V 2 t) sin (nra) 

h "~ 2 fo (l ■■ l ‘ 2)si " < lx 

LESSON 22 

4. The velocity is i with respect to the time scale t - nt 

5. s — >'/r 

LESSON 23 

*' (il)- ,C| ' (d) ' ;,nd (e » ;, rc elliptic, (b) is hyperbolic. 
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4 - Hn = 0 

5 - <W - u Hl j = 0 

LESSON 24 


5. u(x. t) = ~J x ^ >‘>(°- 0) d« 

LESSON 25 

'• U{XJ > = 1 + e- 1 ‘cos(T*) + ie-^* J ‘cos(3«, . 

1 u(x.t)=^B nS in(nnx) 

6 Jo el F "( s )ds, F n (s) is the sine transform of f(x,t 

4. Ail B n ’s are zero except B, = 1 and B 3 = 1/2. 

6. u(x, t ) = f; Bn (t) sin (nxx) where B n (t) is found from 

5 » , (0 + (nir) a B n (0 = /? ,r t 1 a., n = 2 

\ (-l) n+1 (2a-n) njt 3 
5 t(0) = 1, , B„(0) = o n = 2, 3. ••• 

LESSON 26 

U(X,t) = (3n r j ? ( 1 ~ cos (3,rt )) Pm}' + sin (£ r ) cos"'^) 

4 In in* Jr r S0 ' U,i0n f ° r (a) 3nd (C) - not a solution for (b) and ,d) 

' et ° ne thC «*•*" «* non homogeneous. 




LESSON 27 

I. «(j;, /.) = cos (x - l) 



4. «(,7:.n = Fi.r-i)< '''■ 

5. u(j-.f) ~ FV2s - -•>' - u)' 

LESSON 26 ] 

1 . J( , < o has characteristics :r = t„ > 0 has characteristics 1 = -U -■ 

2. f(u) = r i y 

% ulx.t) = otir - 1u ~ k ' 

4. I<(.r.f) = — lr.(/ + \) + c>{x-t) 


3 ^ + =0. w(r) = A + B\nr 

x dr 2 r fir 

4 . u'.r) = .4 4- — 

5. Since u, :u . 4 - u yy = 0 at each point (a, y) the height of the surface u(z. y) = if/ is 
approximately equal to the average of the values on a small circle around (*, y ). 

LESSON 32 

1 . u(r, 0) — r sin 6 (good guess) 

2. No. the net flux is not zero. 

4. d 2 u/dr* + v.= 0,u(0) = vCl.) = 0-. 


LESSON 29 

[0 0 0 

1 . .4=1 o 0 

|_o 0 1 

2. A, = 3. A‘i = f 2 



0 

0 


u-i (x.t) = — 3f) + ty(.T + t) 

u 2 (x.t) = 26 (x-Zt)- 2 w(x + t.) 


LESSON 30 

3 . u (r,1)~ ^ . 4 m J»(A: u „,r)cos(fc(imf) 

4 = — J- [ r() -r i )J 0 (k 0m r)dr 

./f( A„„,) Jo 

4. u(r.f) = ./o(2.4r) cos (2.4f) 

5 w ( r ./) = J 0 (2.4r)c.os(2.4f) - ^ J 0 (8.C5r) cos (S. 6 of) 

4 - i .At (14.937-) cos (14 .93/ ) 


LESSON 31 



LESSON 33 

2. (a) u(r.0) = 14- rsin0+ -cos0 

(b) u(r.0) = 2 

(c) u(r.0) = rsin0 

- (d) u(r, 0) = r 3 sin (30) 

i %$$*■**•■ «M)-- !jsin0 

r 2 

4. u(r.0) = j sin (20) 

5. u(r.0) = ^ sin0 - | - ~ cos20 - ^ cos40 - ^ cos60 j 


7R 


16 P- 


LESSON 34 

1. U (r.0)={-5 + |:}cos0+{|-|}sin0 

2. (a) u(r. 0) = 1 

(b) u(r.0) = 1 + cos (30) 

• (c) ■ w ( r. 0) = - sin 0 + cos (30) 
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LESSON 39 



j LESSON 40 

I 2. Solve for a and b from the equations ^££1 = 0 and 91^1 = o. 

On Ob 

LESSON 41 

1. (a) Parabolic, canonical, (b) hyperbolic, not canonical, (c) elliptic, not canonical, 

(d) parabolic, canonical, 

r 2. 16 'U„„ + u = 2 


LESSON 44 

I. V( x ) — x 

2.. my 4- ky = 0 

LESSON 45 

1. J\u\ = f [ '[ul + ul + 2u] dx dy 

Jo Jo 

2 ■ + 

LESSON 47 

1. Conformal except at z = ±1. 

2. The first three quadrants. 



4. o(r.0) = ^ 
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APPENDIX 1 

Integral Transform Tables . 


Table A: 

Exponential Fourier transform 

Table B; 

Fourier sine transform 

Table C: 

Fourier cosine transform 

Table D: 

Finite Fourier sine transform 

Table E: 

Finite Fourier cosine transform 

Table F: 

Laplace transform 


Definitions of Functions in Tables 


g'T 8 (jc) = delta function 

^ it 


Heaviside function 


Reflected Heaviside function 


TABLE A Exponential Fourier Transform 


/« 

= &->\F) 

= vb L dw 

F((V) = S ‘[f\ = f dr 

1. 

/'(*> 


iu)F(to) 

2. 

n x) 


-u-F(u) 

3. 

rw 

(nth derivative) 

(iiu)" F(u>) 

4. 

Aax) 

a > 0 
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TABLE A (cont.) 
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} TABLE A (cont.)- 


/(■*) 

= j F(a))c~ Ja> 

FM = ?(/! = -= J /(. r)e 

— dx 

18. 

i - M W < i 
o M > i 



19. 

cos (ax) 

r 

1— [8(a> -r a) + 8(a) - a)| 


20. 

sin (ax) 

i ^ [8(a) - a) - 8(a) - a)] 



TABLE B Fourier Sine Transform 


f(x) = J' F(o>) sin (aur) dw 

0 < x < » • 

/(“) = ^ l f(x) sin ( 

0 < 0) < X 


1. f(x) 

-a) 2 f( w) + l mf{ 0) 


2. f(ax) 

H;) 


' 3 ‘ 

■n (a 1 + ur) 


4. .f 1 ' 2 

[wf 


5. H(a - x) 

^ [1 - cos la>a)] 
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TABLE B Fourier Sine Transform 


fix) = j[ F { UJJ sin (ioa) dw 

Ffw) = ~ /(a) sin (cox) t/.v 

ft < .V < X 

0 < uj < * 

*• 7T4 

^""sinui 

1 - 

9 ' tan x 

w 

10. -x'fix) 

;F>! 

11. erfc(xS2 Va) 

•>« 

TABLE C Fourier Cosine Transform 

fix) = jf Fin)) cos (wx) dw 

| j[ /(a) cos («) dx 

0 < x < *> 

0<u><"° 

1. fix) 

-u> ! F((o) - |/'(0) 

2. f(ax) 

^(co/fl) 

3. e- 

2(7 

4. 5(a) 

f 2 1” 

6. H(a - x) 

1™J 

sin (flio) 

7. r— : 

V'ito r 
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TABLE D (cont.) 


f(x) = £ S; sin (nx) 

s « ~ ~ l fix) sin (nx) dx 

0 S .r s it 

n — 1.2..., 

2. sin (mx) m= 1.2.3 


3- 2 a. sin (nx) 

a - 

5. x 


6. 1 

h [x ~ 

j;: 

jjcos ( na ) 0 < a < ir 

e f (ir - a)x x*Sa 

[(it - x)a x > .a 

j^sin (na) 0 < a < ir 

9. \r 


. sinh a(iT - .r) 

2 n 

sinh a-u 

w(rt- + a 1 ) 

TABLE E Finite Cosine Transform 


The finite cosine transform transforms 
n = 0, 1, 2. ... by means of the formu 

a function /(*), 0 =s * s; ir into a sequence C 
la 

c - = ;l 

f(x) cos (nx) dx 

It IS convenient, insofar as the tables ar 
lie in the interval [0.ir|. The reader can 
the transformation 

e concerned, for the range of the variable c to 
transform any other interval [«.h| into [U.-] via 
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There is nothing mysterious about the finite cosine transform; the members of the se- 
quence C„ are the coefficients of cos (nx) in the Fourier cosine series of )\x). That is. 

/(*) = J + t < cos (nx) 
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6. The author of. a famous text on PD E. 

7. In order for separation of variables to work, the PDE must be 

10. A first-order equation of the form u, + /, = 0 is called a 

equation. 

12. When we solve Laplace’s equation in polar coordinates by sepa- 
ration of variables, the ODE in r is named after this man. 

13. The equation u„ = u XI is commonly called the 

equation. 

14. The equation «„ + u, + u y — 0 is a differential 

equation. 

16. A useful way to solve the equation u, = Du„ - vu x is by 

coordinates. 

19. The equation u, = u„ is commonly called the 

‘ equation. 

22. The Crank-Nicolson method is an method. 

24. The of a BVP quite often are proportional to 

the natural frequencies of the problem. 

27. When solving Laplace's equation in spherical coordinates by sep- 
aration of variables, the ODE in <j> is called 

equation. j 

28. The potential due to a point charge is called 

function. 

29. The most basic idea behind the solution to linear problems is 

33. A method of minimizing functionals by replacing the functions by 
polynomials is due to 

35. If the dependent variable is found explicitly as a function of the 

independent variables of the problem, we have an 

solution. 

38. A fampus mathematician/physicist responsible for the discovery of 
- calculus and some differential equations. ■- 

40. The quantity that measures the difference between a function at 

a point and its surrounding points. * * 

41. The basic vibrations of a membrane are called the 

solutions. 

Down 

2. An integral transform in which the kernel is a Bessel function. 

?. PDE can be simplified by changing the variables of the problem 
to variables. 

4. A famous mathematician who died at the age of 27 and hau nothing 
to do with PDEs. 

6. Initial-boundary-value problems defined on bounded domains can 
be solved by integral transforms. 

PDE Crossword Puzzle 409 


ER = 0 is called 


8. The PDE rR ” - >R‘ - k'R = 0 is called - 

equation. 

9. Waves of the form [cos iiml) sin (/tur)] are called 

waves. 

11. A numerical method in which the time increment must be kept 
small. 

15 jhe ODE in > we must solve when solving the vihrating circular 
membrane is due to __ 

17. The BVP of the second kind is called the 

problem. 

18. The u , term in the equation u, = Du xx - vu is related to the 

E of the material. 

20. Responsible for a very elegant solution of the one-dimensional 
wave equation in free space. 

23. A transform that changes derivatives to multiplication is called an 
transformation. 

25. The equation e*u xl + u y> = 0 is a PDE of the 

type. 

26. The PDE u, - u xx is called the — equation. 

29^ If the solutions of a PDE are standing waves, then we might call 
the PDE a — equation. 

30. The PDE u„ + u yy = f{x,y) is named after — 

31. The Legendre polynomials {P„(*)} are on 

the interval [0,1]. • 

32. Most nonlinear PDEs must be solved by __ — 

methods. ". ,. 

34. An integral transform that we generally use on the time variable 
is due to 

36. The PDE problem with only IC is called a 

problem. • 

37. A BVP in which the BC relates the flux to the solution at the 

boundary is called a BVP of the — kind. 

39. The normal derivative at the boundary of a region is related to the 

of material across the boundary. 

40. The director of the Courant Institute of Mathematical Sciences is 

Professor 



APPENDIX 3 


Laplacian in Different Coordinate 
Systems 


- Um Two dimensional cartesian Laplac 


u + L u , + — u M Two dimensional polar Laplacian 

" . . r . . r 

u + «., + u. t Three dimensional cartesian Laplacian 


h u., Three dimensional cylindrical Laplacian 


: 0 Three dimensional 

spherical Laplacian 





Spherical coordinate 
system 
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APPENDIX 4 


Types of Partial Differential 
Equations 


Elliptic Partial Differential Equations 
57 2 u = 0 Laplace’s equation 

V J u + K 2 u = 0 Helmholtz's equation 

V 2 tt = k Poisson's equation 

V 2 u + k(E - V)u = 0 Schrodinger's equation 

Hyperbolic Partial Differential Equations 
«» = c 2 u„ One dimensional vibrating string 
u „ = c 2 «„ - hu, Vibrating string with friction 
u„ - c 2 u„ - hu, - ku Transmission line equation 
u„ = c*Ui, + J[x,t) Wave equation with forced vibrations 
“» = c 2 V 2 u Wave equation in higher dimensions 
“« = c 2 V J u - hu, Wave equation with friction 


Parabolic Partial Differential Equations 
xx One-dimensional diffusion equation 
„ - hu. Diffusion-convection equation 
, - ku Diffusion with lateral heat-concentration loss 
, + flx.t) Diffusion with heat source (or loss) 


I Index 

f 

1 Analytical solution, 324 

t Annulus, Dirichlet problem, 270 

Beam problem, 16 1 
Bessel’s equation, 234 
; Bessel’s functions, 235 

Boundary conditions: Dirichlet (first kind), 
! 14,146,255 

j Neumann (second kind), 20, 146, 256 

Robin (third kind), 23, 146, 258 
Brachistocrone problem, 353 

■ Calculus of variations, 353 

Canonical coordinates, 135 
Canonical form of PDEs: elliptic, 174, 331 
hyperbolic, 174- 
parabolic, 174, 331 
Cauchy problem, 93 

Characteristic curves, 138, 144, 178, 205 
Characteristic equations, 177 
| Classification of PDEs, 174, 331 

' Complementary error function, 79, 103 

Conformal mapping, 382 
Conservation equation, 29, 213 
Convection, 6 1 , 112 
Convection-diffusion equation, 112 
Convolution: finite, 100 
infinite, 91 .... . 

Crank-Nicolson method, 317 
Crossword puzzle, 398 

D'Alembert solution, 129 
Delta function, 293 
Descent, method of, 188 
Diffusion, 112 

Diffusion-convection equation, 112 
Diffusion equation, 13 
Diffusivity, 25 
Dimensionless variable. 168 
Dirichlet's theorem, 83 
Drumhead, vibrating, 232 
Duhamel’s principle, 106 

Eigenfunction expansion, 64 
Eigenvalues, 52, 225 


Eigenvectors, 66, 225 
Elliptic equation, 6, 174 
Error function, 79, 103 
Euler’s equation, 272 
Euler's formulas, 82 
Euler-Lagrange equation, 356 
Exterior BVPs, 276 

Fermat's principle, 359 
Finite difference methods: explicit, 309 
implicit, 317 
Finite differences, 301 
Finite transforms, 72 
First order PDEs, 205 
Flux, 21,113 
Fourier coefficients, 82 
Fourier cosine transform, 73 
Fourier series, 81 
Fourier sine transform, 73 
Fourier transform, 81 
Free space wave equation, 183 
Functionals, 353 

Fundamental solutions, 37, 163, 237 

Green’s function, 94, 290 

Harmonics, 82, 158 
Heat equation: derivation, 27 
Heaviside equation, 114 
Helmholtz equation, 233 
Hluygen’s principle, 183 
Hyperbolic equations, 6,123 

Impulse-response function, 94, a90 
Initial-boundary value problem, 14, 24 
Initial value problem, 93 , 1 1 5 
Integral transforms: cosine, 73 
finite cosine, 73, 191 
finite sine, 73, 191 
Hankel, 74, 104 
Laplace, 74, 97, 106 
sine, 73 

Interior Dirichlet problem, 262 
Kernel of integral transform, 72 
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Laplace's equation: in an annulus. 270 



Legendre's equaiion. 284 



Logarithmic potential, 278 


Matrix algebra, review. 225 
Method of characteristics, 205 
Minimum energy method. 362 
Monte Carlo methods. 340 • 

Moving coordinates, 1 12 

Newtonian potential, 282 
Newton's law of cooling, 21 
Nonhomogcncous BCs, 4 3 
Nonltomogeneous PDEs. 6, 199, 290 
Nonlinear PDEs. 213 

Numerical methods: elliptic equation, 301 
explicit, 318 
implicit, 318 

parabolic equation, 310, 318 

Orthogonality, 38, 82 

Parabolic equation, 6 
Parameter identification, 326 
Perturbation methods, 370 
Point sources and sinks, 291 
Poisson’s equation. 290 
Poisson's formula for free space, 186 
Poisson's integral formula. 262, 265. 296 
Potential: logarithmic, 278 
Newtonian. 282 

Random numbers. 342 
Reflection of waves. 143 
Rita, method of. 362 
Rodrigues' formula, 284 

Schwarz-Christoffe! transformation, 386 
Separation of variables, 33. 49, 155 
Shock waves. 213, 21? 


Specific heat, 30 

Spectrum of a function, 75. 83, 85 
Spherical harmonics, 280 
Standing waves. 153. 237 
Steady state solution. 68, 254 
Stokes theorem. 185 
Sturm-Liouville problem. 56 
Superposition. 95. 198 
Systems of PDEs. 223 

Tables of integral transforms, 389 
Telephone equation. 125 
Thermal capacity, 29 
Thermal conductivity, 22, 30 
Tour du wino. 346 
Traffic flow, 217 

Transformations: of boundary conditions, 

of dependent variables, 169 
of hard problems to easy ones, 58 
of independent variables, 70 
Transient solution, 45, 68 
Transmission line equation, 126 
Travelling waves, 134, 139 

Undeiermined coefficients, 70 

Vibrating beam, 161 
Vibrating drumhead, 232 ; 

Vibrating string, 123 V'™ 

Vibrations: longituainal,J25, -148 . 
torsional, 125,148 
transverse, 123, 148 

Wave equation: derivation, 123, 
in free space. 183 
one dimensional, 123, 129 
three dimensional, 184, 247 
Waves: cylindrical, 183 
free space, 183 
moving. 112 
plane. 183 
spherical, 183 
standing. 153 
travelling. 134, 139 

Young's modulus, 149 
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